Sep 28 16:57:29 devstack cinder-volume[75899]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 16:57:29 devstack cinder-volume[75899]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 16:57:29 devstack cinder-volume[75899]: we strongly recommend against using it for new projects. Sep 28 16:57:29 devstack cinder-volume[75899]: If you are already using Eventlet, we recommend migrating to a different Sep 28 16:57:29 devstack cinder-volume[75899]: framework. For more detail see Sep 28 16:57:29 devstack cinder-volume[75899]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 16:57:29 devstack cinder-volume[75899]: import eventlet # noqa Sep 28 16:57:31 devstack cinder-volume[75899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75899) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 16:57:31 devstack cinder-volume[75899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75899) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 16:57:31 devstack cinder-volume[75899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75899) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 16:57:32 devstack cinder-volume[75899]: INFO dbcounter [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Registered counter for database cinder Sep 28 16:57:32 devstack cinder-volume[75899]: DEBUG oslo_db.sqlalchemy.engines [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75899) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:57:33 devstack cinder-volume[75899]: DEBUG dbcounter [-] [75899] Writer thread running {{(pid=75899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 16:57:33 devstack cinder-volume[75899]: INFO cinder.rpc [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 16:57:33 devstack cinder-volume[75899]: INFO cinder.rpc [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 16:57:33 devstack cinder-volume[75899]: DEBUG oslo_db.sqlalchemy.engines [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75899) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:57:33 devstack cinder-volume[75899]: INFO cinder.volume.manager [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Determined volume DB was empty at startup. Sep 28 16:57:33 devstack cinder-volume[75899]: DEBUG cinder.volume.manager [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75899) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 16:57:33 devstack cinder-volume[75899]: INFO cinder.volume.manager [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 16:57:33 devstack cinder-volume[75899]: WARNING stevedore.named [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 16:57:33 devstack cinder-volume[75899]: WARNING castellan.key_manager [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 16:57:33 devstack cinder-volume[75899]: WARNING cinder.keymgr.conf_key_mgr [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 16:57:33 devstack cinder-volume[75899]: DEBUG cinder.volume.drivers.lvm [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75899) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 16:57:33 devstack cinder-volume[75899]: DEBUG oslo_concurrency.processutils [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:33 devstack cinder-volume[75899]: DEBUG oslo_concurrency.processutils [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] CMD "cinder-rtstool verify" returned: 0 in 0.406s {{(pid=75899) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:33 devstack cinder-volume[75899]: DEBUG oslo_db.sqlalchemy.engines [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75899) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:57:33 devstack cinder-volume[75899]: INFO cinder.rpc [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 16:57:33 devstack cinder-volume[75899]: INFO cinder.rpc [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 16:57:33 devstack cinder-volume[75899]: WARNING stevedore.named [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 16:57:33 devstack cinder-volume[75899]: WARNING castellan.key_manager [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 16:57:33 devstack cinder-volume[75899]: INFO cinder.volume.manager [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_db.sqlalchemy.engines [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75899) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:57:34 devstack cinder-volume[75899]: INFO oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Starting 1 workers Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Started child 76055 {{(pid=75899) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Full set of CONF: {{(pid=75899) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] ******************************************************************************** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Configuration options gathered from: {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 16:57:34 devstack cinder-volume[76055]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] ================================================================================ {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] allow_availability_zone_fallback = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] allow_compression_on_image_upload = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] allowed_direct_url_schemes = [] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] api_rate_limit = True {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] auth_strategy = keystone {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] az_cache_duration = 3600 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_availability_zone = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_host = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_name = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_stats_polling_interval = 60 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backup_api_class = cinder.backup.api.API {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backup_name_template = backup-%s {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backup_use_same_host = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backup_use_temp_snapshot = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] chap_password = **** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] chap_username = {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cinder_internal_tenant_project_id = 8eb3bd005eaa451084bc01dd545d7164 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cinder_internal_tenant_user_id = 64e421d4c32540f8a02dd3381412a568 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cloned_volume_same_az = True {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cluster = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] compression_format = gzip {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] compute_api_class = cinder.compute.nova.API {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] config_dir = [] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] config_source = [] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] control_exchange = openstack {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] debug = True {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] default_availability_zone = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] default_group_type = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] default_volume_type = lvmdriver-1 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] disk_geometry = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] driver_client_cert = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] driver_client_cert_key = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] driver_data_namespace = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] driver_ssl_cert_path = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] driver_ssl_cert_verify = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] driver_use_ssl = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] enable_force_upload = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] enable_new_services = True {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] enable_unsupported_driver = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] enabled_backends = ['lvmdriver-1'] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] enforce_multipath_for_image_xfer = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] filter_function = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] glance_api_insecure = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] glance_api_servers = ['http://192.168.122.135/image'] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] glance_api_ssl_compression = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] glance_ca_certificates_file = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] glance_catalog_info = image:glance:publicURL {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] glance_certfile = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] glance_keyfile = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] glance_num_retries = 3 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] glance_request_timeout = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] goodness_function = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] graceful_shutdown_timeout = 5 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] group_api_class = cinder.group.api.API {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] host = devstack {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] image_compress_on_upload = True {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] image_conversion_address_space_limit = 1 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] image_conversion_cpu_limit = 60 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] image_conversion_disable = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] image_introspection_address_space_limit = 1 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] image_introspection_cpu_limit = 60 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] image_upload_use_cinder_backend = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] image_upload_use_internal_tenant = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] image_volume_cache_enabled = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] image_volume_cache_max_count = 0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] image_volume_cache_max_size_gb = 0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] init_host_max_objects_retrieval = 0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] instance_format = [instance: %(uuid)s] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] iscsi_target_flags = {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] iscsi_write_cache = on {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] iser_helper = tgtadm {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] iser_ip_address = 192.168.122.135 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] iser_port = 3260 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] log_color = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] log_config_append = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] log_dir = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] log_file = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] log_options = True {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] log_rotate_interval = 1 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] log_rotate_interval_type = days {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] log_rotation_type = none {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[76055]: INFO cinder.volume.manager [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 16:57:34 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] max_age = 0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] max_logfile_count = 30 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] max_logfile_size_mb = 200 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] max_over_subscription_ratio = 20.0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] message_reap_interval = 86400 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] message_ttl = 2592000 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] migration_create_volume_timeout_secs = 300 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] monkey_patch = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] monkey_patch_modules = [] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] my_ip = 192.168.122.135 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] no_snapshot_gb_quota = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] num_iser_scan_tries = 3 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] num_shell_tries = 3 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] num_volume_device_scan_tries = 3 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] nvmeof_conn_info_version = 1 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] nvmet_ns_id = 10 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] nvmet_port_id = 1 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] osapi_max_limit = 1000 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] osapi_volume_ext_list = [] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] osapi_volume_listen = 0.0.0.0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] osapi_volume_listen_port = 8776 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] osapi_volume_use_ssl = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] osapi_volume_workers = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] per_volume_size_limit = -1 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] periodic_fuzzy_delay = 60 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] periodic_interval = 60 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] project_id_regex = [0-9a-f\-]+ {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] public_endpoint = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] publish_errors = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] quota_backup_gigabytes = 1000 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] quota_backups = 10 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] quota_gigabytes = 1000 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] quota_groups = 10 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] quota_snapshots = 10 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] quota_volumes = 10 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] rate_limit_burst = 0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] rate_limit_except_level = CRITICAL {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] rate_limit_interval = 0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] reinit_driver_count = 3 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] replication_device = **** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] report_discard_supported = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] report_interval = 120 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] reservation_clean_interval = 86400 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] reservation_expire = 86400 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] reserved_image_namespaces = [] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] reserved_percentage = 0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] rpc_response_timeout = 120 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] run_external_periodic_tasks = True {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] scst_target_driver = iscsi {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] scst_target_iqn_name = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] service_down_time = 720 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] shell_completion = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] snapshot_name_template = snapshot-%s {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] snapshot_same_host = True {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] split_loggers = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] state_path = /opt/stack/data/cinder {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] storage_availability_zone = nova {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] storage_protocol = iSCSI {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] syslog_log_facility = LOG_USER {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] target_helper = lioadm {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] target_ip_address = 192.168.122.135 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] target_port = 3260 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] target_protocol = iscsi {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] target_secondary_ip_addresses = [] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] trace_flags = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] transfer_api_class = cinder.transfer.api.API {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] transport_url = **** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] until_refresh = 0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] use_chap_auth = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] use_default_quota_class = True {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] use_journal = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] use_json = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] use_multipath_for_image_xfer = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] use_stderr = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] use_syslog = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] verify_glance_signatures = enabled {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] volume_api_class = cinder.volume.api.API {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] volume_backend_name = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] volume_clear = zero {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] volume_clear_ionice = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] volume_clear_size = 0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] volume_copy_bps_limit = 0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] volume_dd_blocksize = 1M {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] volume_name_template = volume-%s {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] volume_service_inithost_offload = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] volume_usage_audit_period = month {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] zoning_mode = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:57:34 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.073s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_concurrency.disable_process_locking = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.auth_section = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.auth_type = password {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.auth_version = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.cache = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.certfile = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.delay_auth_decision = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.http_connect_timeout = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.include_service_catalog = True {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.insecure = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.interface = public {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.keyfile = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.memcache_password = **** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:34 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.memcache_username = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.region_name = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.service_token_roles_required = True {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.service_type = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.token_cache_time = 300 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.135/identity {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.backend = dogpile.cache.null {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.backend_argument = **** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.backend_expiration_time = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.config_prefix = cache.oslo {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.debug_cache_backend = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.enable_retry_client = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.enable_socket_keepalive = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.enabled = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.expiration_time = 600 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.hashclient_retry_attempts = 2 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.memcache_dead_retry = 300 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.memcache_pool_maxsize = 10 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.memcache_sasl_enabled = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.password = **** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.proxies = [] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.redis_db = 0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.redis_sentinel_service_name = mymaster {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.redis_server = localhost:6379 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.retry_attempts = 2 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.retry_delay = 0.0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.socket_keepalive_count = 1 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.socket_keepalive_idle = 1 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.socket_keepalive_interval = 1 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.socket_timeout = 1.0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.tls_allowed_ciphers = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.tls_cafile = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.tls_certfile = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.tls_enabled = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:34 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.tls_keyfile = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cache.username = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] coordination.backend_url = **** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.asyncio_connection = **** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.asyncio_slave_connection = **** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.backend = sqlalchemy {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.connection = **** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.connection_debug = 0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.connection_parameters = {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.connection_recycle_time = 3600 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.connection_trace = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.db_inc_retry_interval = True {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.db_max_retries = 20 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.db_max_retry_interval = 10 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.db_retry_interval = 1 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.max_overflow = 50 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.max_pool_size = 5 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.max_retries = 10 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.mysql_wsrep_sync_wait = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.pool_timeout = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.retry_interval = 10 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.slave_connection = **** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.sqlite_synchronous = True {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.synchronous_reader = True {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] database.use_db_reconnect = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_tracing.insecure = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] profiler.connection_string = messaging:// {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] profiler.enabled = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] profiler.es_doc_type = notification {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] profiler.es_scroll_size = 10000 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] profiler.es_scroll_time = 2m {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] profiler.filter_error_trace = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] profiler.hmac_keys = **** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] profiler.sentinel_service_name = mymaster {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] profiler.socket_timeout = 0.1 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] profiler.trace_requests = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] profiler.trace_sqlalchemy = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] profiler_jaeger.process_tags = {} {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] profiler_jaeger.service_name_prefix = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] profiler_otlp.service_name_prefix = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_policy.enforce_new_defaults = True {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_policy.policy_default_rule = default {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_policy.policy_file = policy.yaml {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_policy.remote_timeout = 60.0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] privsep_osbrick.group = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] privsep_osbrick.helper_command = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] privsep_osbrick.user = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cinder_sys_admin.group = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cinder_sys_admin.helper_command = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] cinder_sys_admin.user = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] service_user.auth_section = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] service_user.auth_type = password {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] service_user.cafile = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] service_user.certfile = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] service_user.collect_timing = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] service_user.insecure = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] service_user.keyfile = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] service_user.send_service_user_token = True {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] service_user.split_loggers = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] service_user.timeout = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] service_user.tls_ciphers = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] service_user.tls_min_version = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] glance.auth_section = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack sudo[76059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] glance.auth_type = password {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] glance.certfile = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] glance.collect_timing = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] glance.insecure = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] glance.keyfile = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] glance.region_name = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack sudo[76059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] glance.split_loggers = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] glance.timeout = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] glance.tls_ciphers = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] glance.tls_min_version = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.backend_availability_zone = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.chap_password = **** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.chap_username = {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.disk_geometry = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.driver_client_cert = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.driver_client_cert_key = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.driver_data_namespace = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.driver_use_ssl = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.enable_unsupported_driver = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.extra_capabilities = {} {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.filter_function = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.goodness_function = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.iscsi_target_flags = {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.iscsi_write_cache = on {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.iser_helper = tgtadm {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.iser_port = 3260 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.lvm_mirrors = 0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.lvm_share_target = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.lvm_type = auto {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.num_shell_tries = 3 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.nvmet_port_id = 1 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.replication_device = **** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.report_discard_supported = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.reserved_percentage = 0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.scst_target_driver = iscsi {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.scst_target_iqn_name = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.storage_protocol = iSCSI {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.target_helper = tgtadm {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.target_port = 3260 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.target_protocol = iscsi {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.trace_flags = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.unique_fqdn_network = True {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.use_chap_auth = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.volume_backend_name = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.volume_clear = zero {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.volume_clear_ionice = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.volume_clear_size = 0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.volume_group = cinder-volumes {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_reports.file_event_handler = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_reports.log_dir = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.backend_availability_zone = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.backend_host = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.chap_password = **** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.chap_username = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.chiscsi_conf = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.disk_geometry = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.driver_client_cert = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.driver_data_namespace = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.driver_use_ssl = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.extra_capabilities = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.filter_function = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.goodness_function = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.iser_helper = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.iser_ip_address = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.iser_port = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.iser_target_prefix = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.lvm_conf_file = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.lvm_mirrors = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.lvm_share_target = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.lvm_type = auto {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.num_shell_tries = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.nvmet_port_id = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.replication_device = **** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.report_discard_supported = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.reserved_percentage = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.scst_target_driver = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.storage_protocol = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.target_helper = lioadm {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.target_ip_address = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.target_port = 3260 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.target_protocol = iscsi {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.trace_flags = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.use_chap_auth = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.volume_clear = zero {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.volume_clear_size = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] lvmdriver-1.volumes_dir = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.ssl = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.ssl_version = {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_notifications.driver = [] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_notifications.retry = -1 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] oslo_messaging_notifications.transport_url = **** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] key_manager.fixed_key = **** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican.barbican_api_version = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican.barbican_endpoint = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican.barbican_endpoint_type = public {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican.barbican_region_name = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican.cafile = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican.certfile = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican.collect_timing = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican.insecure = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican.keyfile = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican.number_of_retries = 60 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican.retry_delay = 1 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican.send_service_user_token = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican.split_loggers = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican.timeout = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican.tls_ciphers = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican.tls_min_version = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican.verify_ssl = True {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican.verify_ssl_path = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican_service_user.auth_section = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican_service_user.auth_type = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican_service_user.cafile = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican_service_user.certfile = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican_service_user.collect_timing = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican_service_user.insecure = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican_service_user.keyfile = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican_service_user.split_loggers = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican_service_user.timeout = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican_service_user.tls_ciphers = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] barbican_service_user.tls_min_version = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] vault.approle_role_id = **** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] vault.approle_secret_id = **** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] vault.auth_method = approle {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] vault.auth_path = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] vault.kv_mountpoint = secret {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] vault.kv_path = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] vault.kv_version = 2 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] vault.namespace = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] vault.root_token_id = **** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] vault.ssl_ca_crt_file = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] vault.timeout = 60.0 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] vault.token_file = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] vault.token_role = None {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] vault.use_ssl = False {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:57:34 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] ******************************************************************************** {{(pid=75899) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 16:57:34 devstack sudo[76059]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:34 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.409s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:34 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:34 devstack sudo[76066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:57:34 devstack sudo[76066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:35 devstack sudo[76066]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:35 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.354s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:35 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:57:35 devstack cinder-volume[76055]: INFO cinder.brick.local_dev.lvm [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 16:57:35 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:35 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:35 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:35 devstack sudo[76148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:57:35 devstack sudo[76148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:35 devstack sudo[76148]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:35 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.331s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:35 devstack cinder-volume[76055]: DEBUG cinder.brick.local_dev.lvm [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76055) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 16:57:35 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:35 devstack sudo[76282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:57:35 devstack sudo[76282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:35 devstack sudo[76282]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:35 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.501s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:35 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:35 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:35 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:36 devstack sudo[76470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:57:36 devstack sudo[76470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:36 devstack sudo[76470]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:36 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:36 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:36 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:36 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:36 devstack sudo[76582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 16:57:36 devstack sudo[76582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:36 devstack sudo[76582]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:36 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.314s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:36 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:36 devstack sudo[76673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:57:36 devstack sudo[76673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:36 devstack sudo[76673]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:36 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:36 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:36 devstack sudo[76680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:57:36 devstack sudo[76680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:37 devstack sudo[76680]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:37 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.338s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:37 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:37 devstack sudo[76760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:57:37 devstack sudo[76760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:37 devstack sudo[76760]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:37 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:37 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:37 devstack sudo[76764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:57:37 devstack sudo[76764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:37 devstack sudo[76764]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:37 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.350s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:37 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:37 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:37 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:37 devstack sudo[76853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:57:37 devstack sudo[76853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:38 devstack sudo[76853]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:38 devstack cinder-volume[76055]: INFO cinder.volume.drivers.lvm [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 16:57:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:38 devstack sudo[76863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:57:38 devstack sudo[76863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:38 devstack sudo[76863]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:38 devstack cinder-volume[76055]: DEBUG cinder.volume.drivers.lvm [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Updating volume stats {{(pid=76055) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:57:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:38 devstack sudo[76866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:57:38 devstack sudo[76866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:38 devstack sudo[76866]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:38 devstack sudo[76869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:57:38 devstack sudo[76869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:38 devstack sudo[76869]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:38 devstack sudo[76872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:57:38 devstack sudo[76872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:39 devstack sudo[76872]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:39 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:39 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:39 devstack sudo[76875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:57:39 devstack sudo[76875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:39 devstack sudo[76875]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:39 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:39 devstack cinder-volume[76055]: INFO cinder.volume.driver [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Driver hasn't implemented _init_vendor_properties() Sep 28 16:57:39 devstack cinder-volume[76055]: DEBUG cinder.volume.driver [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76055) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 16:57:39 devstack cinder-volume[76055]: DEBUG oslo_db.sqlalchemy.engines [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76055) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:57:39 devstack cinder-volume[76055]: DEBUG dbcounter [-] [76055] Writer thread running {{(pid=76055) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 16:57:39 devstack cinder-volume[76055]: DEBUG cinder.db.api [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Building query based on filter {{(pid=76055) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 16:57:39 devstack cinder-volume[76055]: DEBUG cinder.image.image_utils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76055) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 16:57:39 devstack cinder-volume[76055]: INFO cinder.keymgr.migration [None req-c2d5e791-0058-4f2d-8d38-2de0658f9205 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 16:57:39 devstack cinder-volume[76055]: DEBUG cinder.volume.drivers.lvm [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Updating volume stats {{(pid=76055) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:57:39 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:39 devstack sudo[76879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:57:39 devstack sudo[76879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:39 devstack sudo[76879]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:39 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:39 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:39 devstack sudo[76882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:57:39 devstack sudo[76882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:40 devstack sudo[76882]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:40 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:40 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:40 devstack sudo[76887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:57:40 devstack sudo[76887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:40 devstack sudo[76887]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:40 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:40 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:40 devstack sudo[76891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:57:40 devstack sudo[76891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:40 devstack sudo[76891]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:40 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:40 devstack cinder-volume[76055]: DEBUG cinder.manager [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Notifying Schedulers of capabilities ... {{(pid=76055) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:57:40 devstack cinder-volume[76055]: INFO cinder.volume.manager [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Driver initialization completed successfully. Sep 28 16:57:40 devstack cinder-volume[76055]: INFO cinder.manager [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Initiating service 2 cleanup Sep 28 16:57:40 devstack cinder-volume[76055]: INFO cinder.manager [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Service 2 cleanup completed. Sep 28 16:57:40 devstack cinder-volume[76055]: DEBUG cinder.service [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Creating RPC server for service cinder-volume {{(pid=76055) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 16:57:40 devstack cinder-volume[76055]: DEBUG cinder.service [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76055) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 16:57:40 devstack cinder-volume[76055]: INFO cinder.volume.manager [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 16:57:40 devstack cinder-volume[76055]: DEBUG cinder.volume.drivers.lvm [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Updating volume stats {{(pid=76055) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:57:40 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:40 devstack sudo[76894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:57:40 devstack sudo[76894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:41 devstack sudo[76894]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:41 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:41 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:41 devstack sudo[76897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:57:41 devstack sudo[76897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:41 devstack sudo[76897]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:41 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:41 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:41 devstack sudo[76905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:57:41 devstack sudo[76905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:41 devstack sudo[76905]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:41 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:41 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:41 devstack sudo[76908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:57:41 devstack sudo[76908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:42 devstack sudo[76908]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:42 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:42 devstack cinder-volume[76055]: INFO cinder.volume.manager [None req-bc9d1c04-96f1-492c-a9c6-a5b072952f6e None None] Driver post RPC initialization completed successfully. Sep 28 16:57:44 devstack cinder-volume[75899]: DEBUG dbcounter [-] [75899] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75899) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:57:52 devstack cinder-volume[76055]: DEBUG dbcounter [-] [76055] Writing DB stats cinder:SELECT=3 {{(pid=76055) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:57:52 devstack cinder-volume[76055]: DEBUG dbcounter [-] [76055] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76055) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:58:38 devstack cinder-volume[76055]: DEBUG oslo_service.periodic_task [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76055) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:58:38 devstack cinder-volume[76055]: DEBUG cinder.volume.drivers.lvm [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Updating volume stats {{(pid=76055) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:58:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:58:38 devstack sudo[78803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:58:38 devstack sudo[78803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:58:38 devstack sudo[78803]: pam_unix(sudo:session): session closed for user root Sep 28 16:58:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:58:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:58:38 devstack sudo[78806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:58:38 devstack sudo[78806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:58:38 devstack sudo[78806]: pam_unix(sudo:session): session closed for user root Sep 28 16:58:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:58:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:58:38 devstack sudo[78809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:58:38 devstack sudo[78809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:58:38 devstack sudo[78809]: pam_unix(sudo:session): session closed for user root Sep 28 16:58:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.295s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:58:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:58:38 devstack sudo[78823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:58:38 devstack sudo[78823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:58:39 devstack sudo[78823]: pam_unix(sudo:session): session closed for user root Sep 28 16:58:39 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:58:39 devstack cinder-volume[76055]: DEBUG cinder.manager [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Notifying Schedulers of capabilities ... {{(pid=76055) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:58:39 devstack cinder-volume[76055]: DEBUG oslo_service.periodic_task [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running periodic task VolumeManager._thread_info {{(pid=76055) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:58:39 devstack cinder-volume[76055]: DEBUG cinder.volume.manager [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] thread count: 6 {{(pid=76055) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:58:39 devstack cinder-volume[76055]: DEBUG cinder.volume.manager [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] thread info: [<_MainThread(MainThread, started 136458741629056)>, , , , , ] {{(pid=76055) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:59:38 devstack cinder-volume[76055]: DEBUG oslo_service.periodic_task [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76055) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:59:38 devstack cinder-volume[76055]: DEBUG cinder.volume.drivers.lvm [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Updating volume stats {{(pid=76055) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:59:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:38 devstack sudo[82073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:59:38 devstack sudo[82073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:38 devstack sudo[82073]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:38 devstack sudo[82076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:59:38 devstack sudo[82076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:38 devstack sudo[82076]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:38 devstack sudo[82080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:59:38 devstack sudo[82080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:38 devstack sudo[82080]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:38 devstack sudo[82084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:59:38 devstack sudo[82084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:39 devstack sudo[82084]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:39 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:39 devstack cinder-volume[76055]: DEBUG cinder.manager [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Notifying Schedulers of capabilities ... {{(pid=76055) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:59:39 devstack cinder-volume[76055]: DEBUG oslo_service.periodic_task [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running periodic task VolumeManager._thread_info {{(pid=76055) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:59:39 devstack cinder-volume[76055]: DEBUG cinder.volume.manager [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] thread count: 6 {{(pid=76055) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:59:39 devstack cinder-volume[76055]: DEBUG cinder.volume.manager [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] thread info: [<_MainThread(MainThread, started 136458741629056)>, , , , , ] {{(pid=76055) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:59:52 devstack cinder-volume[76055]: DEBUG dbcounter [-] [76055] Writing DB stats cinder:SELECT=1 {{(pid=76055) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:59:52 devstack cinder-volume[76055]: DEBUG dbcounter [-] [76055] Writing DB stats cinder:UPDATE=1 {{(pid=76055) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:00:38 devstack cinder-volume[76055]: DEBUG oslo_service.periodic_task [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76055) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:00:38 devstack cinder-volume[76055]: DEBUG cinder.volume.drivers.lvm [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Updating volume stats {{(pid=76055) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:00:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:38 devstack sudo[83887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:00:38 devstack sudo[83887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:38 devstack sudo[83887]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:38 devstack sudo[83890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:00:38 devstack sudo[83890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:38 devstack sudo[83890]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:38 devstack sudo[83904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:00:38 devstack sudo[83904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:38 devstack sudo[83904]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:38 devstack sudo[83908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:00:38 devstack sudo[83908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:39 devstack sudo[83908]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:39 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:39 devstack cinder-volume[76055]: DEBUG cinder.manager [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Notifying Schedulers of capabilities ... {{(pid=76055) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:01:38 devstack cinder-volume[76055]: DEBUG oslo_service.periodic_task [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76055) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:01:38 devstack cinder-volume[76055]: DEBUG cinder.volume.drivers.lvm [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Updating volume stats {{(pid=76055) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:01:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:01:38 devstack sudo[85181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:01:38 devstack sudo[85181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:01:38 devstack sudo[85181]: pam_unix(sudo:session): session closed for user root Sep 28 17:01:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:01:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:01:38 devstack sudo[85192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:01:38 devstack sudo[85192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:01:38 devstack sudo[85192]: pam_unix(sudo:session): session closed for user root Sep 28 17:01:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:01:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:01:38 devstack sudo[85195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:01:38 devstack sudo[85195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:01:38 devstack sudo[85195]: pam_unix(sudo:session): session closed for user root Sep 28 17:01:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:01:38 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:01:38 devstack sudo[85201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:01:38 devstack sudo[85201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:01:39 devstack sudo[85201]: pam_unix(sudo:session): session closed for user root Sep 28 17:01:39 devstack cinder-volume[76055]: DEBUG oslo_concurrency.processutils [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76055) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:01:39 devstack cinder-volume[76055]: DEBUG cinder.manager [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Notifying Schedulers of capabilities ... {{(pid=76055) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:01:39 devstack cinder-volume[76055]: DEBUG oslo_service.periodic_task [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] Running periodic task VolumeManager._thread_info {{(pid=76055) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:01:39 devstack cinder-volume[76055]: DEBUG cinder.volume.manager [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] thread count: 6 {{(pid=76055) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:01:39 devstack cinder-volume[76055]: DEBUG cinder.volume.manager [None req-96ce0f81-2d3f-42b3-944d-4305a549f348 None None] thread info: [<_MainThread(MainThread, started 136458741629056)>, , , , , ] {{(pid=76055) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:01:52 devstack cinder-volume[76055]: DEBUG dbcounter [-] [76055] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76055) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:02:19 devstack cinder-volume[75899]: INFO oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Caught SIGTERM, stopping children Sep 28 17:02:19 devstack cinder-volume[75899]: DEBUG oslo_concurrency.lockutils [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Acquiring lock "singleton_lock" {{(pid=75899) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:02:19 devstack cinder-volume[75899]: DEBUG oslo_concurrency.lockutils [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Acquired lock "singleton_lock" {{(pid=75899) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:02:19 devstack cinder-volume[75899]: DEBUG oslo_concurrency.lockutils [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Releasing lock "singleton_lock" {{(pid=75899) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:02:19 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Stop services. {{(pid=75899) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 17:02:19 devstack cinder-volume[75899]: DEBUG oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Killing children. {{(pid=75899) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 17:02:19 devstack cinder-volume[75899]: INFO oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Waiting on 1 children to exit Sep 28 17:02:20 devstack cinder-volume[76055]: DEBUG oslo_concurrency.lockutils [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Acquiring lock "singleton_lock" {{(pid=76055) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:02:20 devstack cinder-volume[76055]: DEBUG oslo_concurrency.lockutils [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Acquired lock "singleton_lock" {{(pid=76055) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:02:20 devstack cinder-volume[76055]: DEBUG oslo_concurrency.lockutils [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Releasing lock "singleton_lock" {{(pid=76055) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:02:20 devstack cinder-volume[76055]: WARNING amqp [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:02:20 devstack cinder-volume[76055]: WARNING amqp [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:02:20 devstack cinder-volume[75899]: INFO oslo_service.backend._eventlet.service [None req-4a36a6d8-2b09-435f-9907-7aa6ef69d77b None None] Child 76055 exited with status 0 Sep 28 17:02:21 devstack cinder-volume[86044]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 17:02:21 devstack cinder-volume[86044]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:02:21 devstack cinder-volume[86044]: we strongly recommend against using it for new projects. Sep 28 17:02:21 devstack cinder-volume[86044]: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:02:21 devstack cinder-volume[86044]: framework. For more detail see Sep 28 17:02:21 devstack cinder-volume[86044]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:02:21 devstack cinder-volume[86044]: import eventlet # noqa Sep 28 17:02:23 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:02:23 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:02:23 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:02:24 devstack cinder-volume[86044]: INFO dbcounter [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Registered counter for database cinder Sep 28 17:02:24 devstack cinder-volume[86044]: DEBUG oslo_db.sqlalchemy.engines [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86044) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG dbcounter [-] [86044] Writer thread running {{(pid=86044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:02:25 devstack cinder-volume[86044]: INFO cinder.rpc [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 17:02:25 devstack cinder-volume[86044]: INFO cinder.rpc [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_db.sqlalchemy.engines [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86044) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:02:25 devstack cinder-volume[86044]: INFO cinder.volume.manager [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Determined volume DB was empty at startup. Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG cinder.volume.manager [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86044) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 17:02:25 devstack cinder-volume[86044]: INFO cinder.volume.manager [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 17:02:25 devstack cinder-volume[86044]: WARNING stevedore.named [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:02:25 devstack cinder-volume[86044]: WARNING castellan.key_manager [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:02:25 devstack cinder-volume[86044]: WARNING cinder.keymgr.conf_key_mgr [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:02:25 devstack cinder-volume[86044]: INFO cinder.volume.manager [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_db.sqlalchemy.engines [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86044) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:02:25 devstack cinder-volume[86044]: INFO oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Starting 1 workers Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Started child 86297 {{(pid=86044) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Full set of CONF: {{(pid=86044) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] ******************************************************************************** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Configuration options gathered from: {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] ================================================================================ {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] allow_availability_zone_fallback = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] allow_compression_on_image_upload = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] allowed_direct_url_schemes = [] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] api_rate_limit = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] auth_strategy = keystone {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_availability_zone = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_host = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86297]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_name = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_stats_polling_interval = 60 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backup_api_class = cinder.backup.api.API {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backup_name_template = backup-%s {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backup_use_same_host = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backup_use_temp_snapshot = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] chap_password = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] chap_username = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cinder_internal_tenant_project_id = 8eb3bd005eaa451084bc01dd545d7164 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cinder_internal_tenant_user_id = 64e421d4c32540f8a02dd3381412a568 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cluster = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] compression_format = gzip {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] compute_api_class = cinder.compute.nova.API {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] config_dir = [] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] config_source = [] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] control_exchange = openstack {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] debug = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] default_availability_zone = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] default_group_type = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] default_volume_type = QuobyteHD {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] disk_geometry = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] driver_client_cert = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] driver_client_cert_key = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] driver_data_namespace = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] driver_ssl_cert_path = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] driver_ssl_cert_verify = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] driver_use_ssl = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] enable_new_services = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] enable_unsupported_driver = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] enabled_backends = ['QuobyteHD'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] enforce_multipath_for_image_xfer = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] filter_function = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] glance_api_insecure = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] glance_api_servers = ['http://192.168.122.135/image'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] glance_api_ssl_compression = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] glance_ca_certificates_file = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] glance_catalog_info = image:glance:publicURL {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] glance_certfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] glance_keyfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] glance_num_retries = 3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] glance_request_timeout = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] goodness_function = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] graceful_shutdown_timeout = 5 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] group_api_class = cinder.group.api.API {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] host = devstack {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] image_compress_on_upload = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] image_conversion_address_space_limit = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] image_conversion_cpu_limit = 60 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] image_conversion_disable = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] image_introspection_address_space_limit = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] image_introspection_cpu_limit = 60 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] image_upload_use_cinder_backend = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] image_upload_use_internal_tenant = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] image_volume_cache_enabled = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] image_volume_cache_max_count = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] image_volume_cache_max_size_gb = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] init_host_max_objects_retrieval = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] instance_format = [instance: %(uuid)s] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] iscsi_target_flags = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86297]: INFO cinder.volume.manager [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] iscsi_write_cache = on {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86297]: DEBUG cinder.volume.drivers.remotefs [None req-543609ed-77e3-4794-940f-1046bc215268 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86297) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] iser_helper = tgtadm {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] iser_ip_address = 192.168.122.135 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] iser_port = 3260 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] log_color = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] log_config_append = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] log_dir = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] log_file = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] log_options = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] log_rotate_interval = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] log_rotate_interval_type = days {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] log_rotation_type = none {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] max_age = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] max_logfile_count = 30 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] max_logfile_size_mb = 200 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] max_over_subscription_ratio = 20.0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] message_reap_interval = 86400 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] message_ttl = 2592000 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] migration_create_volume_timeout_secs = 300 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] monkey_patch = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] monkey_patch_modules = [] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] my_ip = 192.168.122.135 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] no_snapshot_gb_quota = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] num_iser_scan_tries = 3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] num_shell_tries = 3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] num_volume_device_scan_tries = 3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] nvmeof_conn_info_version = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] nvmet_ns_id = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] nvmet_port_id = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] osapi_max_limit = 1000 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] osapi_volume_ext_list = [] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] osapi_volume_listen = 0.0.0.0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] osapi_volume_listen_port = 8776 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] osapi_volume_use_ssl = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] osapi_volume_workers = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] per_volume_size_limit = -1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] periodic_fuzzy_delay = 60 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] periodic_interval = 60 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] project_id_regex = [0-9a-f\-]+ {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] public_endpoint = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] publish_errors = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] quota_backup_gigabytes = 1000 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] quota_backups = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] quota_gigabytes = 1000 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] quota_groups = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] quota_snapshots = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] quota_volumes = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] rate_limit_burst = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] rate_limit_except_level = CRITICAL {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] rate_limit_interval = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] reinit_driver_count = 3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] replication_device = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] report_discard_supported = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] report_interval = 120 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] reservation_clean_interval = 86400 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] reservation_expire = 86400 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] reserved_image_namespaces = [] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] reserved_percentage = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86297]: DEBUG cinder.volume.drivers.quobyte [None req-543609ed-77e3-4794-940f-1046bc215268 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86297) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 17:02:25 devstack cinder-volume[86297]: WARNING cinder.volume.drivers.quobyte [None req-543609ed-77e3-4794-940f-1046bc215268 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] rpc_response_timeout = 120 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] run_external_periodic_tasks = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86297]: WARNING cinder.volume.drivers.quobyte [None req-543609ed-77e3-4794-940f-1046bc215268 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] scst_target_driver = iscsi {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] scst_target_iqn_name = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] service_down_time = 720 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] shell_completion = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] snapshot_name_template = snapshot-%s {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] split_loggers = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] state_path = /opt/stack/data/cinder {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] storage_availability_zone = nova {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86297]: DEBUG oslo_concurrency.processutils [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Running cmd (subprocess): mount.quobyte {{(pid=86297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] storage_protocol = iSCSI {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] syslog_log_facility = LOG_USER {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] target_helper = lioadm {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] target_ip_address = 192.168.122.135 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] target_port = 3260 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] target_protocol = iscsi {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] target_secondary_ip_addresses = [] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] trace_flags = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] transfer_api_class = cinder.transfer.api.API {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] transport_url = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] until_refresh = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] use_chap_auth = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] use_default_quota_class = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] use_journal = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] use_json = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] use_multipath_for_image_xfer = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] use_stderr = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] use_syslog = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] verify_glance_signatures = enabled {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] volume_api_class = cinder.volume.api.API {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] volume_backend_name = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] volume_clear = zero {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] volume_clear_ionice = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] volume_clear_size = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] volume_copy_bps_limit = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] volume_dd_blocksize = 1M {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] volume_name_template = volume-%s {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] volume_service_inithost_offload = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] volume_usage_audit_period = month {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] zoning_mode = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_concurrency.disable_process_locking = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.auth_section = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.auth_type = password {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.auth_version = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.cache = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.certfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.delay_auth_decision = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.http_connect_timeout = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.include_service_catalog = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.insecure = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.interface = public {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.keyfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.memcache_password = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.memcache_username = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.region_name = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.service_token_roles_required = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.service_type = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.token_cache_time = 300 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.135/identity {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.backend = dogpile.cache.null {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.backend_argument = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.backend_expiration_time = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.config_prefix = cache.oslo {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.debug_cache_backend = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.enable_retry_client = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.enable_socket_keepalive = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.enabled = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.expiration_time = 600 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.hashclient_retry_attempts = 2 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.memcache_dead_retry = 300 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.memcache_pool_maxsize = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.memcache_sasl_enabled = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.password = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.proxies = [] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.redis_db = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.redis_sentinel_service_name = mymaster {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.redis_server = localhost:6379 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.retry_attempts = 2 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.retry_delay = 0.0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.socket_keepalive_count = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.socket_keepalive_idle = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.socket_keepalive_interval = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.socket_timeout = 1.0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.tls_allowed_ciphers = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.tls_cafile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.tls_certfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.tls_enabled = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.tls_keyfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cache.username = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] coordination.backend_url = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.asyncio_connection = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.asyncio_slave_connection = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.backend = sqlalchemy {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.connection = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.connection_debug = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.connection_parameters = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.connection_recycle_time = 3600 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.connection_trace = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.db_inc_retry_interval = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.db_max_retries = 20 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.db_max_retry_interval = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.db_retry_interval = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.max_overflow = 50 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.max_pool_size = 5 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.max_retries = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.mysql_wsrep_sync_wait = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.pool_timeout = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.retry_interval = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.slave_connection = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.sqlite_synchronous = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.synchronous_reader = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] database.use_db_reconnect = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_tracing.insecure = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] profiler.connection_string = messaging:// {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] profiler.enabled = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] profiler.es_doc_type = notification {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] profiler.es_scroll_size = 10000 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] profiler.es_scroll_time = 2m {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] profiler.filter_error_trace = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] profiler.hmac_keys = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] profiler.sentinel_service_name = mymaster {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] profiler.socket_timeout = 0.1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] profiler.trace_requests = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] profiler.trace_sqlalchemy = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] profiler_jaeger.process_tags = {} {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] profiler_jaeger.service_name_prefix = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] profiler_otlp.service_name_prefix = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_policy.enforce_new_defaults = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_policy.policy_default_rule = default {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_policy.policy_file = policy.yaml {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_policy.remote_timeout = 60.0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] privsep_osbrick.group = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] privsep_osbrick.helper_command = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] privsep_osbrick.user = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cinder_sys_admin.group = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cinder_sys_admin.helper_command = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] cinder_sys_admin.user = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] service_user.auth_section = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] service_user.auth_type = password {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] service_user.cafile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] service_user.certfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] service_user.collect_timing = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] service_user.insecure = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] service_user.keyfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] service_user.send_service_user_token = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] service_user.split_loggers = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack quobyte-client[86302]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 17:02:25 devstack quobyte-client[86302]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] service_user.timeout = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] service_user.tls_ciphers = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] service_user.tls_min_version = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] glance.auth_section = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] glance.auth_type = password {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] glance.certfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] glance.collect_timing = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] glance.insecure = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] glance.keyfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] glance.region_name = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] glance.split_loggers = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86297]: DEBUG oslo_concurrency.processutils [None req-543609ed-77e3-4794-940f-1046bc215268 None None] CMD "mount.quobyte" returned: 1 in 0.139s {{(pid=86297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:25 devstack cinder-volume[86297]: DEBUG oslo_concurrency.lockutils [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] glance.timeout = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] glance.tls_ciphers = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] glance.tls_min_version = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.backend_availability_zone = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.chap_password = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86297]: DEBUG oslo_concurrency.lockutils [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.chap_username = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86297]: DEBUG cinder.volume.drivers.quobyte [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=86297) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.disk_geometry = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.driver_client_cert = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.driver_client_cert_key = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.driver_data_namespace = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86297]: INFO cinder.volume.drivers.quobyte [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d ... Sep 28 17:02:25 devstack cinder-volume[86297]: DEBUG oslo_concurrency.processutils [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 -c /etc/quobyte/client-cinder.cfg {{(pid=86297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.driver_use_ssl = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.enable_unsupported_driver = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.extra_capabilities = {} {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.filter_function = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.goodness_function = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.iscsi_target_flags = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.iscsi_write_cache = on {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.iser_helper = tgtadm {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.iser_port = 3260 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.nas_host = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.nas_login = admin {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.nas_mount_options = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.nas_password = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.nas_private_key = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.nas_share_path = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.nas_ssh_port = 22 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.num_shell_tries = 3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.nvmet_port_id = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.quobyte_client_cfg = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.quobyte_volume_url = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.replication_device = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.report_discard_supported = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.reserved_percentage = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.scst_target_driver = iscsi {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.scst_target_iqn_name = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.storage_protocol = iSCSI {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.target_helper = tgtadm {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.target_port = 3260 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.target_protocol = iscsi {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.trace_flags = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.unique_fqdn_network = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.use_chap_auth = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.volume_backend_name = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.volume_clear = zero {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.volume_clear_ionice = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.volume_clear_size = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_reports.file_event_handler = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_reports.log_dir = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.backend_availability_zone = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.backend_host = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack sudo[86305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 -c /etc/quobyte/client-cinder.cfg Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.chap_password = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack sudo[86305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.chap_username = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.chiscsi_conf = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.disk_geometry = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.driver_client_cert = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.driver_client_cert_key = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.driver_data_namespace = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.driver_use_ssl = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.extra_capabilities = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.filter_function = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.goodness_function = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.iscsi_target_flags = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.iscsi_write_cache = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.iser_helper = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.iser_ip_address = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.iser_port = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.iser_target_prefix = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.nas_host = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.nas_login = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.nas_mount_options = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.nas_password = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.nas_private_key = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.nas_share_path = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.nas_ssh_port = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.num_shell_tries = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.nvmet_ns_id = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.nvmet_port_id = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.replication_device = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.report_discard_supported = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.reserved_percentage = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.scst_target_driver = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.storage_protocol = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.target_helper = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.target_ip_address = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.target_port = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.target_prefix = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.target_protocol = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.trace_flags = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.unique_fqdn_network = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.use_chap_auth = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.volume_clear = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.volume_clear_ionice = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.volume_clear_size = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] QuobyteHD.volumes_dir = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.ssl = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.ssl_version = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_notifications.driver = [] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_notifications.retry = -1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] oslo_messaging_notifications.transport_url = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] key_manager.fixed_key = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican.barbican_api_version = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican.barbican_endpoint = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican.barbican_endpoint_type = public {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican.barbican_region_name = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican.cafile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican.certfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican.collect_timing = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican.insecure = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican.keyfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican.number_of_retries = 60 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican.retry_delay = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican.send_service_user_token = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican.split_loggers = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican.timeout = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican.tls_ciphers = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican.tls_min_version = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican.verify_ssl = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican.verify_ssl_path = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican_service_user.auth_section = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican_service_user.auth_type = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican_service_user.cafile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican_service_user.certfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican_service_user.collect_timing = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican_service_user.insecure = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican_service_user.keyfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican_service_user.split_loggers = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican_service_user.timeout = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican_service_user.tls_ciphers = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] barbican_service_user.tls_min_version = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] vault.approle_role_id = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] vault.approle_secret_id = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] vault.auth_method = approle {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] vault.auth_path = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] vault.kv_mountpoint = secret {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] vault.kv_path = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] vault.kv_version = 2 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] vault.namespace = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] vault.root_token_id = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] vault.ssl_ca_crt_file = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] vault.timeout = 60.0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] vault.token_file = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] vault.token_role = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] vault.use_ssl = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:25 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] ******************************************************************************** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 17:02:26 devstack sudo[86305]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:26 devstack cinder-volume[86297]: DEBUG oslo_concurrency.processutils [None req-543609ed-77e3-4794-940f-1046bc215268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.520s {{(pid=86297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:26 devstack cinder-volume[86297]: INFO cinder.volume.drivers.quobyte [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d succeeded Sep 28 17:02:26 devstack cinder-volume[86297]: DEBUG cinder.volume.drivers.quobyte [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=86297) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:26 devstack cinder-volume[86297]: DEBUG oslo_concurrency.lockutils [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.538s {{(pid=86297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:26 devstack cinder-volume[86297]: DEBUG oslo_concurrency.processutils [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=86297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:26 devstack sudo[86413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:02:26 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:26 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:26 devstack cinder-volume[86297]: DEBUG oslo_concurrency.processutils [None req-543609ed-77e3-4794-940f-1046bc215268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.256s {{(pid=86297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:26 devstack cinder-volume[86297]: INFO cinder.volume.driver [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 17:02:26 devstack cinder-volume[86297]: DEBUG cinder.volume.driver [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.150650024414, 'free_capacity_gb': 1775.150650024414, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86297) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 17:02:26 devstack cinder-volume[86297]: DEBUG oslo_db.sqlalchemy.engines [None req-543609ed-77e3-4794-940f-1046bc215268 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86297) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:02:26 devstack cinder-volume[86297]: DEBUG dbcounter [-] [86297] Writer thread running {{(pid=86297) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:02:26 devstack cinder-volume[86297]: DEBUG cinder.db.api [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Building query based on filter {{(pid=86297) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 17:02:26 devstack cinder-volume[86297]: DEBUG cinder.image.image_utils [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86297) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 17:02:26 devstack cinder-volume[86297]: INFO cinder.keymgr.migration [None req-5fdc6f2c-3012-428c-83d9-2d2afe70bddc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 17:02:26 devstack cinder-volume[86297]: DEBUG oslo_concurrency.lockutils [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:26 devstack cinder-volume[86297]: DEBUG oslo_concurrency.lockutils [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:26 devstack cinder-volume[86297]: DEBUG cinder.volume.drivers.quobyte [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=86297) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:26 devstack cinder-volume[86297]: DEBUG cinder.volume.drivers.quobyte [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=86297) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:26 devstack cinder-volume[86297]: DEBUG oslo_concurrency.lockutils [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:26 devstack cinder-volume[86297]: DEBUG oslo_concurrency.processutils [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=86297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:26 devstack sudo[86424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:02:26 devstack sudo[86424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:26 devstack sudo[86424]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:26 devstack cinder-volume[86297]: DEBUG oslo_concurrency.processutils [None req-543609ed-77e3-4794-940f-1046bc215268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.275s {{(pid=86297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:26 devstack cinder-volume[86297]: DEBUG cinder.manager [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Notifying Schedulers of capabilities ... {{(pid=86297) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:02:26 devstack cinder-volume[86297]: INFO cinder.volume.manager [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Driver initialization completed successfully. Sep 28 17:02:26 devstack cinder-volume[86297]: INFO cinder.manager [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Initiating service 3 cleanup Sep 28 17:02:26 devstack cinder-volume[86297]: INFO cinder.manager [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Service 3 cleanup completed. Sep 28 17:02:26 devstack cinder-volume[86297]: DEBUG cinder.service [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Creating RPC server for service cinder-volume {{(pid=86297) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 17:02:26 devstack cinder-volume[86297]: DEBUG cinder.service [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86297) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 17:02:27 devstack cinder-volume[86297]: INFO cinder.volume.manager [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 17:02:27 devstack cinder-volume[86297]: DEBUG oslo_concurrency.lockutils [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:27 devstack cinder-volume[86297]: DEBUG oslo_concurrency.lockutils [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:27 devstack cinder-volume[86297]: DEBUG cinder.volume.drivers.quobyte [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=86297) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:27 devstack cinder-volume[86297]: DEBUG cinder.volume.drivers.quobyte [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=86297) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:27 devstack cinder-volume[86297]: DEBUG oslo_concurrency.lockutils [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:27 devstack cinder-volume[86297]: DEBUG oslo_concurrency.processutils [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=86297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:27 devstack sudo[86435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:02:27 devstack sudo[86435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:27 devstack sudo[86435]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:27 devstack cinder-volume[86297]: DEBUG oslo_concurrency.processutils [None req-543609ed-77e3-4794-940f-1046bc215268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.375s {{(pid=86297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:27 devstack cinder-volume[86297]: INFO cinder.volume.manager [None req-543609ed-77e3-4794-940f-1046bc215268 None None] Driver post RPC initialization completed successfully. Sep 28 17:02:32 devstack cinder-volume[86044]: INFO oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Caught SIGTERM, stopping children Sep 28 17:02:32 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Acquiring lock "singleton_lock" {{(pid=86044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:02:32 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Acquired lock "singleton_lock" {{(pid=86044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:02:32 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Releasing lock "singleton_lock" {{(pid=86044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:02:32 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Stop services. {{(pid=86044) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 17:02:32 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Killing children. {{(pid=86044) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 17:02:32 devstack cinder-volume[86044]: INFO oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Waiting on 1 children to exit Sep 28 17:02:35 devstack cinder-volume[86297]: DEBUG oslo_concurrency.lockutils [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Acquiring lock "singleton_lock" {{(pid=86297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:02:35 devstack cinder-volume[86297]: DEBUG oslo_concurrency.lockutils [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Acquired lock "singleton_lock" {{(pid=86297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:02:35 devstack cinder-volume[86297]: DEBUG oslo_concurrency.lockutils [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Releasing lock "singleton_lock" {{(pid=86297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:02:35 devstack cinder-volume[86297]: WARNING amqp [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:02:35 devstack cinder-volume[86297]: WARNING amqp [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:02:35 devstack cinder-volume[86044]: INFO oslo_service.backend._eventlet.service [None req-1278fcfb-ea7e-46a1-98df-551032df01de None None] Child 86297 exited with status 0 Sep 28 17:02:36 devstack cinder-volume[86762]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 17:02:36 devstack cinder-volume[86762]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:02:36 devstack cinder-volume[86762]: we strongly recommend against using it for new projects. Sep 28 17:02:36 devstack cinder-volume[86762]: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:02:36 devstack cinder-volume[86762]: framework. For more detail see Sep 28 17:02:36 devstack cinder-volume[86762]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:02:36 devstack cinder-volume[86762]: import eventlet # noqa Sep 28 17:02:39 devstack cinder-volume[86762]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86762) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:02:39 devstack cinder-volume[86762]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86762) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:02:39 devstack cinder-volume[86762]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86762) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:02:40 devstack cinder-volume[86762]: INFO dbcounter [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] Registered counter for database cinder Sep 28 17:02:40 devstack cinder-volume[86762]: DEBUG oslo_db.sqlalchemy.engines [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86762) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG dbcounter [-] [86762] Writer thread running {{(pid=86762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:02:41 devstack cinder-volume[86762]: INFO cinder.rpc [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 17:02:41 devstack cinder-volume[86762]: INFO cinder.rpc [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_db.sqlalchemy.engines [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86762) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:02:41 devstack cinder-volume[86762]: INFO cinder.volume.manager [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] Determined volume DB was empty at startup. Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG cinder.volume.manager [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86762) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 17:02:41 devstack cinder-volume[86762]: WARNING stevedore.named [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:02:41 devstack cinder-volume[86762]: WARNING castellan.key_manager [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:02:41 devstack cinder-volume[86762]: WARNING cinder.keymgr.conf_key_mgr [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:02:41 devstack cinder-volume[86762]: INFO cinder.volume.manager [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_db.sqlalchemy.engines [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86762) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:02:41 devstack cinder-volume[86762]: INFO oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] Starting 1 workers Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] Started child 87061 {{(pid=86762) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] Full set of CONF: {{(pid=86762) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] ******************************************************************************** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] Configuration options gathered from: {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 17:02:41 devstack cinder-volume[87061]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] ================================================================================ {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] allow_availability_zone_fallback = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] allow_compression_on_image_upload = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] allowed_direct_url_schemes = [] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] api_rate_limit = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] auth_strategy = keystone {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_availability_zone = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_host = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_name = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_stats_polling_interval = 60 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backup_api_class = cinder.backup.api.API {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backup_name_template = backup-%s {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backup_use_same_host = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backup_use_temp_snapshot = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] chap_password = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] chap_username = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cinder_internal_tenant_project_id = 8eb3bd005eaa451084bc01dd545d7164 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cinder_internal_tenant_user_id = 64e421d4c32540f8a02dd3381412a568 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cluster = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] compression_format = gzip {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] compute_api_class = cinder.compute.nova.API {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] config_dir = [] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] config_source = [] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] control_exchange = openstack {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] debug = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] default_availability_zone = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] default_group_type = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] default_volume_type = QuobyteHD {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] disk_geometry = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] driver_client_cert = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] driver_client_cert_key = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] driver_data_namespace = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] driver_ssl_cert_path = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] driver_ssl_cert_verify = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] driver_use_ssl = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] enable_new_services = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] enable_unsupported_driver = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] enabled_backends = ['QuobyteHD'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] enforce_multipath_for_image_xfer = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] filter_function = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] glance_api_insecure = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] glance_api_servers = ['http://192.168.122.135/image'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] glance_api_ssl_compression = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] glance_ca_certificates_file = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] glance_catalog_info = image:glance:publicURL {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] glance_certfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] glance_keyfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] glance_num_retries = 3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] glance_request_timeout = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] goodness_function = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] graceful_shutdown_timeout = 5 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] group_api_class = cinder.group.api.API {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] host = devstack {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] image_compress_on_upload = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] image_conversion_address_space_limit = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] image_conversion_cpu_limit = 60 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] image_conversion_disable = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] image_introspection_address_space_limit = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] image_introspection_cpu_limit = 60 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] image_upload_use_cinder_backend = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] image_upload_use_internal_tenant = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] image_volume_cache_enabled = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] image_volume_cache_max_count = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] image_volume_cache_max_size_gb = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] init_host_max_objects_retrieval = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 17:02:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87061) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] instance_format = [instance: %(uuid)s] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] iscsi_target_flags = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] iscsi_write_cache = on {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] iser_helper = tgtadm {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] iser_ip_address = 192.168.122.135 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] iser_port = 3260 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] log_color = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] log_config_append = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] log_dir = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] log_file = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] log_options = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] log_rotate_interval = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] log_rotate_interval_type = days {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] log_rotation_type = none {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] max_age = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] max_logfile_count = 30 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] max_logfile_size_mb = 200 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] max_over_subscription_ratio = 20.0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] message_reap_interval = 86400 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] message_ttl = 2592000 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] migration_create_volume_timeout_secs = 300 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] monkey_patch = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] monkey_patch_modules = [] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] my_ip = 192.168.122.135 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] no_snapshot_gb_quota = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] num_iser_scan_tries = 3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] num_shell_tries = 3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] num_volume_device_scan_tries = 3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] nvmeof_conn_info_version = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] nvmet_ns_id = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] nvmet_port_id = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] osapi_max_limit = 1000 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] osapi_volume_ext_list = [] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] osapi_volume_listen_port = 8776 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] osapi_volume_use_ssl = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] osapi_volume_workers = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] per_volume_size_limit = -1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] periodic_fuzzy_delay = 60 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] periodic_interval = 60 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] public_endpoint = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] publish_errors = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] quota_backup_gigabytes = 1000 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] quota_backups = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] quota_gigabytes = 1000 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] quota_groups = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] quota_snapshots = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] quota_volumes = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] rate_limit_burst = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] rate_limit_except_level = CRITICAL {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] rate_limit_interval = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] reinit_driver_count = 3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] replication_device = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] report_discard_supported = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] report_interval = 120 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] reservation_clean_interval = 86400 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] reservation_expire = 86400 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] reserved_image_namespaces = [] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] reserved_percentage = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] rpc_response_timeout = 120 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] run_external_periodic_tasks = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] scst_target_driver = iscsi {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] scst_target_iqn_name = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] service_down_time = 720 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] shell_completion = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] snapshot_name_template = snapshot-%s {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] split_loggers = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] state_path = /opt/stack/data/cinder {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] storage_availability_zone = nova {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] storage_protocol = iSCSI {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] syslog_log_facility = LOG_USER {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87061) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] target_helper = lioadm {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] target_ip_address = 192.168.122.135 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.quobyte [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 17:02:41 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.quobyte [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] target_port = 3260 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Running cmd (subprocess): mount.quobyte {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] target_protocol = iscsi {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] target_secondary_ip_addresses = [] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] trace_flags = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] transport_url = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] until_refresh = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] use_chap_auth = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] use_default_quota_class = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] use_journal = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] use_json = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] use_multipath_for_image_xfer = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] use_stderr = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] use_syslog = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] verify_glance_signatures = enabled {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] volume_api_class = cinder.volume.api.API {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] volume_backend_name = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] volume_clear = zero {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] volume_clear_ionice = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] volume_clear_size = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] volume_copy_bps_limit = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] volume_dd_blocksize = 1M {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] volume_name_template = volume-%s {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] volume_service_inithost_offload = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] volume_usage_audit_period = month {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] zoning_mode = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_concurrency.disable_process_locking = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.auth_section = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.auth_type = password {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.auth_version = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.cache = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.certfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.include_service_catalog = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.insecure = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.interface = public {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.keyfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.memcache_password = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.memcache_username = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.region_name = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.service_type = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.135/identity {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.backend = dogpile.cache.null {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.backend_argument = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.backend_expiration_time = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.config_prefix = cache.oslo {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.debug_cache_backend = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.enable_retry_client = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.enable_socket_keepalive = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.enabled = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.expiration_time = 600 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.hashclient_retry_attempts = 2 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.memcache_dead_retry = 300 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.memcache_pool_maxsize = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.memcache_sasl_enabled = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.password = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.proxies = [] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.redis_db = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.redis_server = localhost:6379 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.retry_attempts = 2 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.retry_delay = 0.0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.socket_keepalive_count = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.socket_keepalive_idle = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.socket_keepalive_interval = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.socket_timeout = 1.0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.tls_allowed_ciphers = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.tls_cafile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.tls_certfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.tls_enabled = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.tls_keyfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cache.username = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] coordination.backend_url = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.asyncio_connection = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.asyncio_slave_connection = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.backend = sqlalchemy {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.connection = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.connection_debug = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.connection_parameters = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.connection_recycle_time = 3600 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.connection_trace = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.db_inc_retry_interval = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.db_max_retries = 20 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.db_max_retry_interval = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] CMD "mount.quobyte" returned: 1 in 0.095s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.db_retry_interval = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.max_overflow = 50 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.max_pool_size = 5 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.max_retries = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.mysql_wsrep_sync_wait = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.pool_timeout = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.retry_interval = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.slave_connection = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.sqlite_synchronous = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.synchronous_reader = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] database.use_db_reconnect = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_tracing.insecure = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] profiler.connection_string = messaging:// {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] profiler.enabled = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] profiler.es_doc_type = notification {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] profiler.es_scroll_size = 10000 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] profiler.es_scroll_time = 2m {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] profiler.filter_error_trace = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] profiler.hmac_keys = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] profiler.sentinel_service_name = mymaster {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] profiler.socket_timeout = 0.1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] profiler.trace_requests = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] profiler.trace_sqlalchemy = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] profiler_jaeger.process_tags = {} {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] profiler_jaeger.service_name_prefix = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] profiler_otlp.service_name_prefix = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_policy.enforce_new_defaults = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_policy.policy_default_rule = default {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_policy.policy_file = policy.yaml {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] privsep_osbrick.group = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] privsep_osbrick.helper_command = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] privsep_osbrick.user = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cinder_sys_admin.group = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cinder_sys_admin.helper_command = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] cinder_sys_admin.user = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] service_user.auth_section = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] service_user.auth_type = password {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] service_user.cafile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] service_user.certfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] service_user.collect_timing = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] service_user.insecure = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] service_user.keyfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] service_user.send_service_user_token = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] service_user.split_loggers = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] service_user.timeout = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] service_user.tls_ciphers = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] service_user.tls_min_version = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] glance.auth_section = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] glance.auth_type = password {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] glance.certfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack sudo[87065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:02:41 devstack sudo[87065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] glance.collect_timing = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] glance.insecure = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] glance.keyfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] glance.region_name = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] glance.split_loggers = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] glance.timeout = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] glance.tls_ciphers = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] glance.tls_min_version = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.backend_availability_zone = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.chap_password = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.chap_username = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.disk_geometry = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.driver_client_cert = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.driver_client_cert_key = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.driver_data_namespace = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.driver_use_ssl = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.extra_capabilities = {} {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.filter_function = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.goodness_function = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.iscsi_target_flags = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.iscsi_write_cache = on {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.iser_helper = tgtadm {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.iser_port = 3260 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.nas_host = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.nas_login = admin {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.nas_mount_options = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.nas_password = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.nas_private_key = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.nas_share_path = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.num_shell_tries = 3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.quobyte_volume_url = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.replication_device = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.report_discard_supported = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.reserved_percentage = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.target_helper = tgtadm {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.target_port = 3260 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.target_protocol = iscsi {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.trace_flags = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.unique_fqdn_network = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.use_chap_auth = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.volume_backend_name = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.volume_clear = zero {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.volume_clear_ionice = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.volume_clear_size = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_reports.file_event_handler = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_reports.log_dir = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.backend_availability_zone = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.backend_host = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.chap_password = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.chap_username = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.chiscsi_conf = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.disk_geometry = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.driver_client_cert = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.driver_data_namespace = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.driver_use_ssl = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.extra_capabilities = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.filter_function = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.goodness_function = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.iser_helper = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.iser_ip_address = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.iser_port = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.iser_target_prefix = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.nas_host = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.nas_login = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.nas_mount_options = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.nas_password = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.nas_private_key = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.nas_share_path = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.nas_ssh_port = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.num_shell_tries = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.nvmet_port_id = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.replication_device = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.report_discard_supported = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.reserved_percentage = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.scst_target_driver = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.storage_protocol = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.target_helper = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.target_ip_address = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.target_port = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.target_prefix = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.target_protocol = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.trace_flags = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.use_chap_auth = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.volume_clear = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.volume_clear_size = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] QuobyteHD.volumes_dir = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.ssl = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_notifications.driver = [] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_notifications.retry = -1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] key_manager.fixed_key = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican.barbican_api_version = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican.barbican_endpoint = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican.barbican_endpoint_type = public {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican.barbican_region_name = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican.cafile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican.certfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican.collect_timing = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican.insecure = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican.keyfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican.number_of_retries = 60 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican.retry_delay = 1 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican.send_service_user_token = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican.split_loggers = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican.timeout = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican.tls_ciphers = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican.tls_min_version = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican.verify_ssl = True {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican.verify_ssl_path = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican_service_user.auth_section = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican_service_user.auth_type = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican_service_user.cafile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican_service_user.certfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican_service_user.collect_timing = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican_service_user.insecure = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican_service_user.keyfile = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican_service_user.split_loggers = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican_service_user.timeout = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican_service_user.tls_ciphers = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] barbican_service_user.tls_min_version = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] vault.approle_role_id = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] vault.approle_secret_id = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] vault.auth_method = approle {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] vault.auth_path = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] vault.kv_mountpoint = secret {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] vault.kv_path = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] vault.kv_version = 2 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] vault.namespace = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] vault.root_token_id = **** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] vault.ssl_ca_crt_file = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] vault.timeout = 60.0 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] vault.token_file = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] vault.token_role = None {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] vault.use_ssl = False {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:02:41 devstack cinder-volume[86762]: DEBUG oslo_service.backend._eventlet.service [None req-a006b8a7-2f46-49e9-a6e3-c2e2c3a0f826 None None] ******************************************************************************** {{(pid=86762) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 17:02:41 devstack sudo[87065]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.249s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:41 devstack cinder-volume[87061]: INFO cinder.volume.driver [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 17:02:41 devstack cinder-volume[87061]: DEBUG cinder.volume.driver [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.12845993042, 'free_capacity_gb': 1775.12845993042, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87061) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 17:02:41 devstack cinder-volume[87061]: DEBUG oslo_db.sqlalchemy.engines [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87061) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:02:42 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writer thread running {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:02:42 devstack cinder-volume[87061]: DEBUG cinder.db.api [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Building query based on filter {{(pid=87061) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 17:02:42 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87061) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 17:02:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:42 devstack cinder-volume[87061]: INFO cinder.keymgr.migration [None req-d3918c59-eb94-41e1-86dd-7a3805ca2171 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 17:02:42 devstack sudo[87068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:02:42 devstack sudo[87068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:42 devstack sudo[87068]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.262s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:42 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:02:42 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Driver initialization completed successfully. Sep 28 17:02:42 devstack cinder-volume[87061]: INFO cinder.manager [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Initiating service 3 cleanup Sep 28 17:02:42 devstack cinder-volume[87061]: INFO cinder.manager [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Service 3 cleanup completed. Sep 28 17:02:42 devstack cinder-volume[87061]: DEBUG cinder.service [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Creating RPC server for service cinder-volume {{(pid=87061) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 17:02:42 devstack cinder-volume[87061]: DEBUG cinder.service [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87061) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 17:02:42 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 17:02:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:42 devstack sudo[87071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:02:42 devstack sudo[87071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:42 devstack sudo[87071]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.255s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:42 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-9ae1e87f-835d-4741-9981-86d7014b2a79 None None] Driver post RPC initialization completed successfully. Sep 28 17:02:51 devstack cinder-volume[86762]: DEBUG dbcounter [-] [86762] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:02:52 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:02:52 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=3 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:03:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:03:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 6 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:03:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:03:41 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:03:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Flow 'volume_create_manager' (a763b886-d576-484a-899a-29ef1ea6bf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:03:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3b7bac-2865-4464-998f-13dd39ba5f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3b7bac-2865-4464-998f-13dd39ba5f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-475755936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=540bd05c-3124-4672-8fd7-10b758ee00df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43641f4fb2bd490f8692fba5f07359f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:03:42Z,use_quota=True,user_id='cc08d5fbd63b4de0bb68be2b24276143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eebf195-eeb4-4bb9-828f-a820c0212b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eebf195-eeb4-4bb9-828f-a820c0212b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8ad701-4829-427e-bf80-2a1f1164248f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8ad701-4829-427e-bf80-2a1f1164248f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '540bd05c-3124-4672-8fd7-10b758ee00df', 'volume_name': 'volume-540bd05c-3124-4672-8fd7-10b758ee00df', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a140f97b-20f6-4614-9778-d5c26a1b2c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a140f97b-20f6-4614-9778-d5c26a1b2c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9967be99-60f8-4b21-9427-2c31d0169897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:41 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Volume 540bd05c-3124-4672-8fd7-10b758ee00df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-540bd05c-3124-4672-8fd7-10b758ee00df', 'volume_size': 1} Sep 28 17:03:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:03:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-475755936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=540bd05c-3124-4672-8fd7-10b758ee00df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43641f4fb2bd490f8692fba5f07359f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:03:42Z,use_quota=True,user_id='cc08d5fbd63b4de0bb68be2b24276143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:03:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Creating volume 540bd05c-3124-4672-8fd7-10b758ee00df {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:03:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:03:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:03:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:03:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:03:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:03:41 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:03:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-540bd05c-3124-4672-8fd7-10b758ee00df 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:41 devstack sudo[87264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-540bd05c-3124-4672-8fd7-10b758ee00df 1073741824 Sep 28 17:03:41 devstack sudo[87264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:42 devstack sudo[87264]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-540bd05c-3124-4672-8fd7-10b758ee00df 1073741824" returned: 0 in 0.736s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-540bd05c-3124-4672-8fd7-10b758ee00df {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:42 devstack sudo[87585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-540bd05c-3124-4672-8fd7-10b758ee00df Sep 28 17:03:42 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:42 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-540bd05c-3124-4672-8fd7-10b758ee00df" returned: 0 in 0.322s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:03:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:03:43 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9967be99-60f8-4b21-9427-2c31d0169897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-540bd05c-3124-4672-8fd7-10b758ee00df', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:43 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f52db46-47b7-471b-9f63-4e18f453dbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:43 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Volume volume-540bd05c-3124-4672-8fd7-10b758ee00df (540bd05c-3124-4672-8fd7-10b758ee00df): created successfully Sep 28 17:03:43 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f52db46-47b7-471b-9f63-4e18f453dbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:43 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Flow 'volume_create_manager' (a763b886-d576-484a-899a-29ef1ea6bf83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:03:43 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-0ff2ca6f-fb35-4e2e-a40f-dabd508d8a3d tempest-TaggedAttachmentsTest-426643610 None] Created volume successfully. Sep 28 17:03:53 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:03:53 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:04:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:04:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:06 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:04:06 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:07 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.429s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:04:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:04:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 6 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:04:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Flow 'volume_create_manager' (cc54da79-3c4c-43dc-a297-ef0cb1c75395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ace9194-b9a4-45a8-9f14-27791e96e08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ace9194-b9a4-45a8-9f14-27791e96e08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-838367001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6954929-9096-456c-b934-b101530c4c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea4c1cc120248498ea66dccde1a84aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:04:13Z,use_quota=True,user_id='dd45588d8ee14ec79ff36b5e3ea99b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ac8300-5619-438a-ae56-cb5e18e61f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ac8300-5619-438a-ae56-cb5e18e61f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a9f84f4-8e41-46ab-bed5-89262613e4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a9f84f4-8e41-46ab-bed5-89262613e4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6954929-9096-456c-b934-b101530c4c9b', 'volume_name': 'volume-d6954929-9096-456c-b934-b101530c4c9b', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baaac705-ec81-48db-ac18-61d80cf557cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baaac705-ec81-48db-ac18-61d80cf557cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7e3a61-3a16-42fe-af62-5d598b075576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:13 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Volume d6954929-9096-456c-b934-b101530c4c9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6954929-9096-456c-b934-b101530c4c9b', 'volume_size': 1} Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-838367001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6954929-9096-456c-b934-b101530c4c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea4c1cc120248498ea66dccde1a84aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:04:13Z,use_quota=True,user_id='dd45588d8ee14ec79ff36b5e3ea99b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Creating volume d6954929-9096-456c-b934-b101530c4c9b {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:04:13 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d6954929-9096-456c-b934-b101530c4c9b 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:13 devstack sudo[87913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d6954929-9096-456c-b934-b101530c4c9b 1073741824 Sep 28 17:04:13 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:13 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d6954929-9096-456c-b934-b101530c4c9b 1073741824" returned: 0 in 0.736s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d6954929-9096-456c-b934-b101530c4c9b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:14 devstack sudo[87921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d6954929-9096-456c-b934-b101530c4c9b Sep 28 17:04:14 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:14 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d6954929-9096-456c-b934-b101530c4c9b" returned: 0 in 0.373s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:14 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:04:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:14 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7e3a61-3a16-42fe-af62-5d598b075576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6954929-9096-456c-b934-b101530c4c9b', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:14 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c6861f-3df0-4ce8-82de-0a4e472639ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:14 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Volume volume-d6954929-9096-456c-b934-b101530c4c9b (d6954929-9096-456c-b934-b101530c4c9b): created successfully Sep 28 17:04:14 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c6861f-3df0-4ce8-82de-0a4e472639ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:14 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Flow 'volume_create_manager' (cc54da79-3c4c-43dc-a297-ef0cb1c75395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:04:14 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-b0fc209a-7aef-489e-884e-3c603f17d1d0 tempest-DeleteServersTestJSON-1299437715 None] Created volume successfully. Sep 28 17:04:22 devstack cinder-volume[87061]: WARNING py.warnings [req-ea1ccc3a-dda2-4cd7-86ca-d09d47965c78 req-348fcdff-4213-41a6-8514-d4d2ffa8d2f0 tempest-DeleteServersTestJSON-1299437715 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 28 17:04:22 devstack cinder-volume[87061]: .first() Sep 28 17:04:22 devstack cinder-volume[87061]: Sep 28 17:04:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-ea1ccc3a-dda2-4cd7-86ca-d09d47965c78 req-348fcdff-4213-41a6-8514-d4d2ffa8d2f0 tempest-DeleteServersTestJSON-1299437715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-ea1ccc3a-dda2-4cd7-86ca-d09d47965c78 req-348fcdff-4213-41a6-8514-d4d2ffa8d2f0 tempest-DeleteServersTestJSON-1299437715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-ea1ccc3a-dda2-4cd7-86ca-d09d47965c78 req-348fcdff-4213-41a6-8514-d4d2ffa8d2f0 tempest-DeleteServersTestJSON-1299437715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-ea1ccc3a-dda2-4cd7-86ca-d09d47965c78 req-348fcdff-4213-41a6-8514-d4d2ffa8d2f0 tempest-DeleteServersTestJSON-1299437715 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-d6954929-9096-456c-b934-b101530c4c9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ed8dfa0-38de-4c0f-beba-cb9ba56ad630', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:04:22 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-ea1ccc3a-dda2-4cd7-86ca-d09d47965c78 req-348fcdff-4213-41a6-8514-d4d2ffa8d2f0 tempest-DeleteServersTestJSON-1299437715 None] attachment_update completed successfully. Sep 28 17:04:26 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:04:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Flow 'volume_create_manager' (abd7a512-abab-46f6-a449-2b3fc7d45a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:04:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c073113d-d987-4470-8ee8-ec70c87126d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c073113d-d987-4470-8ee8-ec70c87126d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-752742273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f721d9e1-4bfe-4cf1-9278-460b80647e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ec95c77817425a8bf9bb5bf361d4ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:04:26Z,use_quota=True,user_id='8c4569f020aa4f43a88e679299aff22b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71eec78-2bda-4258-b8aa-cad0be3b8d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71eec78-2bda-4258-b8aa-cad0be3b8d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eeb522b-66e3-465f-b80b-a7c703d5ef57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eeb522b-66e3-465f-b80b-a7c703d5ef57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f721d9e1-4bfe-4cf1-9278-460b80647e38', 'volume_name': 'volume-f721d9e1-4bfe-4cf1-9278-460b80647e38', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db1e56d1-a913-472a-9fc0-d0f48357124e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db1e56d1-a913-472a-9fc0-d0f48357124e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e167476-7fc0-491a-9a75-ade4a4ab7840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:26 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Volume f721d9e1-4bfe-4cf1-9278-460b80647e38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f721d9e1-4bfe-4cf1-9278-460b80647e38', 'volume_size': 1} Sep 28 17:04:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-752742273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f721d9e1-4bfe-4cf1-9278-460b80647e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ec95c77817425a8bf9bb5bf361d4ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:04:26Z,use_quota=True,user_id='8c4569f020aa4f43a88e679299aff22b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:04:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Creating volume f721d9e1-4bfe-4cf1-9278-460b80647e38 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:04:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:04:26 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:04:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f721d9e1-4bfe-4cf1-9278-460b80647e38 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:26 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f721d9e1-4bfe-4cf1-9278-460b80647e38 1073741824 Sep 28 17:04:26 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:27 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f721d9e1-4bfe-4cf1-9278-460b80647e38 1073741824" returned: 0 in 1.068s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f721d9e1-4bfe-4cf1-9278-460b80647e38 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:27 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f721d9e1-4bfe-4cf1-9278-460b80647e38 Sep 28 17:04:27 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:28 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f721d9e1-4bfe-4cf1-9278-460b80647e38" returned: 0 in 0.961s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] <== create_volume: return (2135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:04:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.149s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e167476-7fc0-491a-9a75-ade4a4ab7840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f721d9e1-4bfe-4cf1-9278-460b80647e38', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e992e13-205f-4f73-b6c8-1e43826efb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:28 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Volume volume-f721d9e1-4bfe-4cf1-9278-460b80647e38 (f721d9e1-4bfe-4cf1-9278-460b80647e38): created successfully Sep 28 17:04:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e992e13-205f-4f73-b6c8-1e43826efb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Flow 'volume_create_manager' (abd7a512-abab-46f6-a449-2b3fc7d45a9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:04:28 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-aa64af78-72bf-4204-818e-823b1a26844c tempest-VolumesAdminNegativeTest-277063651 None] Created volume successfully. Sep 28 17:04:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] Acquiring lock "cinder-f721d9e1-4bfe-4cf1-9278-460b80647e38-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] Lock "cinder-f721d9e1-4bfe-4cf1-9278-460b80647e38-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] Acquiring lock "cinder-quobyte-f721d9e1-4bfe-4cf1-9278-460b80647e38" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] Lock "cinder-quobyte-f721d9e1-4bfe-4cf1-9278-460b80647e38" acquired by "delete_volume" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:31 devstack cinder-volume[87061]: INFO oslo.privsep.daemon [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpq0x65yi8/privsep.sock'] Sep 28 17:04:31 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpq0x65yi8/privsep.sock Sep 28 17:04:31 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:32 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-4b4c18da-0745-47a8-b35a-8dc53bee83ca req-ff9542cc-91c4-4989-94d8-b2d60f13209a tempest-DeleteServersTestJSON-1299437715 None] Terminate volume connection completed successfully. Sep 28 17:04:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-4b4c18da-0745-47a8-b35a-8dc53bee83ca req-ff9542cc-91c4-4989-94d8-b2d60f13209a tempest-DeleteServersTestJSON-1299437715 None] Deleting attachment 5ed8dfa0-38de-4c0f-beba-cb9ba56ad630. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:04:33 devstack cinder-volume[87061]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 17:04:33 devstack cinder-volume[87061]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:04:33 devstack cinder-volume[87061]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 17:04:33 devstack cinder-volume[87061]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 17:04:33 devstack cinder-volume[87061]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:04:33 devstack cinder-volume[87061]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 17:04:33 devstack cinder-volume[87061]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:04:33 devstack cinder-volume[87061]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 17:04:33 devstack cinder-volume[87061]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 17:04:34 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:34 devstack cinder-volume[87061]: INFO oslo.privsep.daemon [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] Spawned new privsep daemon via rootwrap Sep 28 17:04:34 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] Accepted privsep connection to /tmp/tmpq0x65yi8/privsep.sock {{(pid=87061) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 17:04:34 devstack cinder-volume[87061]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 17:04:34 devstack cinder-volume[87061]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 17:04:34 devstack cinder-volume[87061]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 17:04:34 devstack cinder-volume[87061]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88635 Sep 28 17:04:34 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07d5dba-cec0-4e76-81ec-238c285ced51]: (2,) {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:04:34 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26cdd68-f58d-41d5-abf9-388f93beae62]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:04:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f721d9e1-4bfe-4cf1-9278-460b80647e38 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:34 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f721d9e1-4bfe-4cf1-9278-460b80647e38 Sep 28 17:04:34 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:34 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f721d9e1-4bfe-4cf1-9278-460b80647e38" returned: 0 in 0.577s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f721d9e1-4bfe-4cf1-9278-460b80647e38 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:34 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f721d9e1-4bfe-4cf1-9278-460b80647e38 Sep 28 17:04:34 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:35 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f721d9e1-4bfe-4cf1-9278-460b80647e38" returned: 0 in 0.330s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:35 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] Lock "cinder-quobyte-f721d9e1-4bfe-4cf1-9278-460b80647e38" released by "delete_volume" :: held 3.688s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:35 devstack cinder-volume[87061]: WARNING cinder.quota [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:04:35 devstack cinder-volume[87061]: WARNING cinder.quota [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:04:35 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] Created reservations ['4c35a376-842c-429c-b727-8ad4548f4717', 'ffff472d-3d4f-427d-b629-9d3f8e156d40', '8eca1412-6e0b-40c8-93e2-f34a4d50fcfd', '45ba1554-ce78-4758-a4e6-f08e855e9a32'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:04:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:35 devstack sudo[88646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:04:35 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:35 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-355dd5be-21b1-4e6e-b3e1-6e3442a44b5e tempest-DeleteServersTestJSON-1299437715 None] Acquiring lock "cinder-d6954929-9096-456c-b934-b101530c4c9b-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:35 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-355dd5be-21b1-4e6e-b3e1-6e3442a44b5e tempest-DeleteServersTestJSON-1299437715 None] Lock "cinder-d6954929-9096-456c-b934-b101530c4c9b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:35 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-355dd5be-21b1-4e6e-b3e1-6e3442a44b5e tempest-DeleteServersTestJSON-1299437715 None] Acquiring lock "cinder-quobyte-d6954929-9096-456c-b934-b101530c4c9b" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:35 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-355dd5be-21b1-4e6e-b3e1-6e3442a44b5e tempest-DeleteServersTestJSON-1299437715 None] Lock "cinder-quobyte-d6954929-9096-456c-b934-b101530c4c9b" acquired by "delete_volume" :: waited 0.046s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:36 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.608s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:36 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:04:36 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] Deleted volume successfully. Sep 28 17:04:36 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0228285-6275-4c33-bd80-f37b22daa622]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:04:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-355dd5be-21b1-4e6e-b3e1-6e3442a44b5e tempest-DeleteServersTestJSON-1299437715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d6954929-9096-456c-b934-b101530c4c9b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-25025e00-d11c-44ac-94ac-236f413e06a5 tempest-VolumesAdminNegativeTest-277063651 None] Lock "cinder-f721d9e1-4bfe-4cf1-9278-460b80647e38-delete_volume" released by "delete_volume" :: held 4.890s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:36 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d6954929-9096-456c-b934-b101530c4c9b Sep 28 17:04:36 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:36 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-355dd5be-21b1-4e6e-b3e1-6e3442a44b5e tempest-DeleteServersTestJSON-1299437715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d6954929-9096-456c-b934-b101530c4c9b" returned: 0 in 0.707s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-355dd5be-21b1-4e6e-b3e1-6e3442a44b5e tempest-DeleteServersTestJSON-1299437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d6954929-9096-456c-b934-b101530c4c9b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:36 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d6954929-9096-456c-b934-b101530c4c9b Sep 28 17:04:36 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:37 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-355dd5be-21b1-4e6e-b3e1-6e3442a44b5e tempest-DeleteServersTestJSON-1299437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d6954929-9096-456c-b934-b101530c4c9b" returned: 0 in 0.346s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-355dd5be-21b1-4e6e-b3e1-6e3442a44b5e tempest-DeleteServersTestJSON-1299437715 None] Lock "cinder-quobyte-d6954929-9096-456c-b934-b101530c4c9b" released by "delete_volume" :: held 1.177s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:37 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-355dd5be-21b1-4e6e-b3e1-6e3442a44b5e tempest-DeleteServersTestJSON-1299437715 None] Created reservations ['57bc2b16-1bfd-4efd-9136-040738c45635', '84ec8c6b-8848-4e9e-858c-a909851ac061', '721fd1cf-076e-409d-a880-b9da8d2b7a64', '824ec131-cf62-45b0-95ca-0c106dab6c39'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:04:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-355dd5be-21b1-4e6e-b3e1-6e3442a44b5e tempest-DeleteServersTestJSON-1299437715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-355dd5be-21b1-4e6e-b3e1-6e3442a44b5e tempest-DeleteServersTestJSON-1299437715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-355dd5be-21b1-4e6e-b3e1-6e3442a44b5e tempest-DeleteServersTestJSON-1299437715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-355dd5be-21b1-4e6e-b3e1-6e3442a44b5e tempest-DeleteServersTestJSON-1299437715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-355dd5be-21b1-4e6e-b3e1-6e3442a44b5e tempest-DeleteServersTestJSON-1299437715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-355dd5be-21b1-4e6e-b3e1-6e3442a44b5e tempest-DeleteServersTestJSON-1299437715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:37 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:04:37 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:38 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-355dd5be-21b1-4e6e-b3e1-6e3442a44b5e tempest-DeleteServersTestJSON-1299437715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.847s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:38 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-355dd5be-21b1-4e6e-b3e1-6e3442a44b5e tempest-DeleteServersTestJSON-1299437715 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:04:38 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-355dd5be-21b1-4e6e-b3e1-6e3442a44b5e tempest-DeleteServersTestJSON-1299437715 None] Deleted volume successfully. Sep 28 17:04:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-355dd5be-21b1-4e6e-b3e1-6e3442a44b5e tempest-DeleteServersTestJSON-1299437715 None] Lock "cinder-d6954929-9096-456c-b934-b101530c4c9b-delete_volume" released by "delete_volume" :: held 2.672s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:52 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=24,cinder:UPDATE=20,cinder:DELETE=2,cinder:INSERT=4 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:04:52 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=20,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:05:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:05:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:06 devstack sudo[88812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:05:06 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:07 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.319s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:05:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-518966d3-68d3-406f-97cd-91a9137f4c98 req-c6621e5e-f75a-4dc4-92b6-a98bc8013a5f tempest-TaggedAttachmentsTest-426643610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-518966d3-68d3-406f-97cd-91a9137f4c98 req-c6621e5e-f75a-4dc4-92b6-a98bc8013a5f tempest-TaggedAttachmentsTest-426643610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-518966d3-68d3-406f-97cd-91a9137f4c98 req-c6621e5e-f75a-4dc4-92b6-a98bc8013a5f tempest-TaggedAttachmentsTest-426643610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-518966d3-68d3-406f-97cd-91a9137f4c98 req-c6621e5e-f75a-4dc4-92b6-a98bc8013a5f tempest-TaggedAttachmentsTest-426643610 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-540bd05c-3124-4672-8fd7-10b758ee00df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4aa58df5-768c-46a1-a7e4-bc9cfc00ddc1', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:05:15 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-518966d3-68d3-406f-97cd-91a9137f4c98 req-c6621e5e-f75a-4dc4-92b6-a98bc8013a5f tempest-TaggedAttachmentsTest-426643610 None] attachment_update completed successfully. Sep 28 17:05:25 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-96f148a1-3f5b-49eb-ac2a-97ccaf776597 req-46fc5fac-a8d6-4e11-910d-a91de90cb78f tempest-TaggedAttachmentsTest-426643610 None] Terminate volume connection completed successfully. Sep 28 17:05:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-96f148a1-3f5b-49eb-ac2a-97ccaf776597 req-46fc5fac-a8d6-4e11-910d-a91de90cb78f tempest-TaggedAttachmentsTest-426643610 None] Deleting attachment 4aa58df5-768c-46a1-a7e4-bc9cfc00ddc1. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:05:35 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:05:35 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:05:53 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:05:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Flow 'volume_create_manager' (2450a27d-440f-43e0-beb7-fb87ff2cb4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0044e802-3e7e-4341-aab8-8fd1b8dd05d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0044e802-3e7e-4341-aab8-8fd1b8dd05d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2130665790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dcaeb85-fe58-451e-a2cd-ecc969680dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6916ba8d077d4834bc8659b75f5a7e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:53Z,use_quota=True,user_id='b08fb3062cb049999dbf68aa2e6bfde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4cae383-0bc6-4a53-aab2-7fe6fbafacb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4cae383-0bc6-4a53-aab2-7fe6fbafacb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970067fc-70bf-4afc-8cc7-2866a0a3a149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970067fc-70bf-4afc-8cc7-2866a0a3a149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dcaeb85-fe58-451e-a2cd-ecc969680dd4', 'volume_name': 'volume-9dcaeb85-fe58-451e-a2cd-ecc969680dd4', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3746b6e8-3999-4714-817c-bdcffece9a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3746b6e8-3999-4714-817c-bdcffece9a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab96639-bada-4fd8-9fe1-0df94be7aea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:53 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Volume 9dcaeb85-fe58-451e-a2cd-ecc969680dd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dcaeb85-fe58-451e-a2cd-ecc969680dd4', 'volume_size': 1} Sep 28 17:05:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2130665790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dcaeb85-fe58-451e-a2cd-ecc969680dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6916ba8d077d4834bc8659b75f5a7e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:53Z,use_quota=True,user_id='b08fb3062cb049999dbf68aa2e6bfde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:05:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Creating volume 9dcaeb85-fe58-451e-a2cd-ecc969680dd4 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:05:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:05:53 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:05:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9dcaeb85-fe58-451e-a2cd-ecc969680dd4 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:53 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9dcaeb85-fe58-451e-a2cd-ecc969680dd4 1073741824 Sep 28 17:05:53 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:55 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9dcaeb85-fe58-451e-a2cd-ecc969680dd4 1073741824" returned: 0 in 1.866s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9dcaeb85-fe58-451e-a2cd-ecc969680dd4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:55 devstack sudo[89899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9dcaeb85-fe58-451e-a2cd-ecc969680dd4 Sep 28 17:05:55 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:56 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9dcaeb85-fe58-451e-a2cd-ecc969680dd4" returned: 0 in 0.548s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:56 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] <== create_volume: return (2559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:05:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.568s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab96639-bada-4fd8-9fe1-0df94be7aea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dcaeb85-fe58-451e-a2cd-ecc969680dd4', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ab6f70-5699-4170-ac98-0c4213e02fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:56 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Volume volume-9dcaeb85-fe58-451e-a2cd-ecc969680dd4 (9dcaeb85-fe58-451e-a2cd-ecc969680dd4): created successfully Sep 28 17:05:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ab6f70-5699-4170-ac98-0c4213e02fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Flow 'volume_create_manager' (2450a27d-440f-43e0-beb7-fb87ff2cb4f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:56 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-ee51530f-910c-4216-be36-26a2db1d0bae tempest-ServerRescueNegativeTestJSON-1860875757 None] Created volume successfully. Sep 28 17:05:58 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eb8a757c-fa61-4e08-a584-5e3b5baaa598 tempest-TaggedAttachmentsTest-426643610 None] Acquiring lock "cinder-540bd05c-3124-4672-8fd7-10b758ee00df-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:58 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eb8a757c-fa61-4e08-a584-5e3b5baaa598 tempest-TaggedAttachmentsTest-426643610 None] Lock "cinder-540bd05c-3124-4672-8fd7-10b758ee00df-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:58 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eb8a757c-fa61-4e08-a584-5e3b5baaa598 tempest-TaggedAttachmentsTest-426643610 None] Acquiring lock "cinder-quobyte-540bd05c-3124-4672-8fd7-10b758ee00df" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:58 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eb8a757c-fa61-4e08-a584-5e3b5baaa598 tempest-TaggedAttachmentsTest-426643610 None] Lock "cinder-quobyte-540bd05c-3124-4672-8fd7-10b758ee00df" acquired by "delete_volume" :: waited 0.048s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:58 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[4235a4aa-d449-4864-a030-05338737675d]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-eb8a757c-fa61-4e08-a584-5e3b5baaa598 tempest-TaggedAttachmentsTest-426643610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-540bd05c-3124-4672-8fd7-10b758ee00df {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:59 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-540bd05c-3124-4672-8fd7-10b758ee00df Sep 28 17:05:59 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:59 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-eb8a757c-fa61-4e08-a584-5e3b5baaa598 tempest-TaggedAttachmentsTest-426643610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-540bd05c-3124-4672-8fd7-10b758ee00df" returned: 0 in 0.860s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-eb8a757c-fa61-4e08-a584-5e3b5baaa598 tempest-TaggedAttachmentsTest-426643610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-540bd05c-3124-4672-8fd7-10b758ee00df {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:59 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-540bd05c-3124-4672-8fd7-10b758ee00df Sep 28 17:05:59 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:00 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-eb8a757c-fa61-4e08-a584-5e3b5baaa598 tempest-TaggedAttachmentsTest-426643610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-540bd05c-3124-4672-8fd7-10b758ee00df" returned: 0 in 0.517s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eb8a757c-fa61-4e08-a584-5e3b5baaa598 tempest-TaggedAttachmentsTest-426643610 None] Lock "cinder-quobyte-540bd05c-3124-4672-8fd7-10b758ee00df" released by "delete_volume" :: held 1.458s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:00 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-eb8a757c-fa61-4e08-a584-5e3b5baaa598 tempest-TaggedAttachmentsTest-426643610 None] Created reservations ['d60f1825-7b14-4229-bcbe-1e9fadc6d670', '18db9b8b-2a0b-42b8-ba00-527916b961a6', 'e30e8f83-306a-4ee3-a354-0d1025fc77e2', '3f85b78a-6ed4-4e4d-91a7-571a719fc823'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-eb8a757c-fa61-4e08-a584-5e3b5baaa598 tempest-TaggedAttachmentsTest-426643610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-eb8a757c-fa61-4e08-a584-5e3b5baaa598 tempest-TaggedAttachmentsTest-426643610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-eb8a757c-fa61-4e08-a584-5e3b5baaa598 tempest-TaggedAttachmentsTest-426643610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-eb8a757c-fa61-4e08-a584-5e3b5baaa598 tempest-TaggedAttachmentsTest-426643610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-eb8a757c-fa61-4e08-a584-5e3b5baaa598 tempest-TaggedAttachmentsTest-426643610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-eb8a757c-fa61-4e08-a584-5e3b5baaa598 tempest-TaggedAttachmentsTest-426643610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:00 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:06:00 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:01 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-eb8a757c-fa61-4e08-a584-5e3b5baaa598 tempest-TaggedAttachmentsTest-426643610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.531s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:01 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-eb8a757c-fa61-4e08-a584-5e3b5baaa598 tempest-TaggedAttachmentsTest-426643610 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:01 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-eb8a757c-fa61-4e08-a584-5e3b5baaa598 tempest-TaggedAttachmentsTest-426643610 None] Deleted volume successfully. Sep 28 17:06:01 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eb8a757c-fa61-4e08-a584-5e3b5baaa598 tempest-TaggedAttachmentsTest-426643610 None] Lock "cinder-540bd05c-3124-4672-8fd7-10b758ee00df-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:06:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:06 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:06:06 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:07 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.622s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:06:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 8 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:06:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:06:09 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Flow 'volume_create_manager' (36afd3a5-e4bc-4ec0-8b63-aa0eae55f34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1ee2b8-cbdc-4935-a0ad-a60b6ea16474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1ee2b8-cbdc-4935-a0ad-a60b6ea16474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1885972943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50c351d-26a5-4f3e-ad62-e81f9b2c0154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c671d5959de4f69af3dece762c5a45e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:10Z,use_quota=True,user_id='d8113dfd66cb4066bed7f21d04697e0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4886b6-b07b-4871-b505-603d3eaee9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4886b6-b07b-4871-b505-603d3eaee9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371282df-8e74-4e24-9fe2-d570c8827b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371282df-8e74-4e24-9fe2-d570c8827b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e50c351d-26a5-4f3e-ad62-e81f9b2c0154', 'volume_name': 'volume-e50c351d-26a5-4f3e-ad62-e81f9b2c0154', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d750f73-a7fe-4a49-a647-db3c321a0703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d750f73-a7fe-4a49-a647-db3c321a0703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed815b5-ffc9-4694-9358-ebfc5d23f14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:09 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Volume e50c351d-26a5-4f3e-ad62-e81f9b2c0154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e50c351d-26a5-4f3e-ad62-e81f9b2c0154', 'volume_size': 1} Sep 28 17:06:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1885972943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50c351d-26a5-4f3e-ad62-e81f9b2c0154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c671d5959de4f69af3dece762c5a45e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:10Z,use_quota=True,user_id='d8113dfd66cb4066bed7f21d04697e0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:06:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Creating volume e50c351d-26a5-4f3e-ad62-e81f9b2c0154 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:06:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:09 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:06:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e50c351d-26a5-4f3e-ad62-e81f9b2c0154 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:09 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e50c351d-26a5-4f3e-ad62-e81f9b2c0154 1073741824 Sep 28 17:06:09 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:11 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e50c351d-26a5-4f3e-ad62-e81f9b2c0154 1073741824" returned: 0 in 1.149s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e50c351d-26a5-4f3e-ad62-e81f9b2c0154 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:11 devstack sudo[90032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e50c351d-26a5-4f3e-ad62-e81f9b2c0154 Sep 28 17:06:11 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:11 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e50c351d-26a5-4f3e-ad62-e81f9b2c0154" returned: 0 in 0.703s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:06:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:11 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed815b5-ffc9-4694-9358-ebfc5d23f14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e50c351d-26a5-4f3e-ad62-e81f9b2c0154', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:11 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee43b6f-df6b-4fde-8f0d-ddfe0271b9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:11 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Volume volume-e50c351d-26a5-4f3e-ad62-e81f9b2c0154 (e50c351d-26a5-4f3e-ad62-e81f9b2c0154): created successfully Sep 28 17:06:11 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee43b6f-df6b-4fde-8f0d-ddfe0271b9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Flow 'volume_create_manager' (36afd3a5-e4bc-4ec0-8b63-aa0eae55f34d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:12 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-796164b9-81f2-4600-b821-d1963d4e048e tempest-ServerActionsTestOtherA-1604287769 None] Created volume successfully. Sep 28 17:06:21 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:06:22 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:UPDATE=12,cinder:SELECT=7,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:06:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-295b806f-bdfd-43fb-9d4e-3098e856523f tempest-ServerRescueNegativeTestJSON-1860875757 None] Acquiring lock "cinder-9dcaeb85-fe58-451e-a2cd-ecc969680dd4-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-295b806f-bdfd-43fb-9d4e-3098e856523f tempest-ServerRescueNegativeTestJSON-1860875757 None] Lock "cinder-9dcaeb85-fe58-451e-a2cd-ecc969680dd4-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-295b806f-bdfd-43fb-9d4e-3098e856523f tempest-ServerRescueNegativeTestJSON-1860875757 None] Acquiring lock "cinder-quobyte-9dcaeb85-fe58-451e-a2cd-ecc969680dd4" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-295b806f-bdfd-43fb-9d4e-3098e856523f tempest-ServerRescueNegativeTestJSON-1860875757 None] Lock "cinder-quobyte-9dcaeb85-fe58-451e-a2cd-ecc969680dd4" acquired by "delete_volume" :: waited 0.099s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:24 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1922ed-c55f-48a0-b6b5-c0a1f0a8fc9e]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-295b806f-bdfd-43fb-9d4e-3098e856523f tempest-ServerRescueNegativeTestJSON-1860875757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9dcaeb85-fe58-451e-a2cd-ecc969680dd4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:24 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9dcaeb85-fe58-451e-a2cd-ecc969680dd4 Sep 28 17:06:24 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:25 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-295b806f-bdfd-43fb-9d4e-3098e856523f tempest-ServerRescueNegativeTestJSON-1860875757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9dcaeb85-fe58-451e-a2cd-ecc969680dd4" returned: 0 in 1.191s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-295b806f-bdfd-43fb-9d4e-3098e856523f tempest-ServerRescueNegativeTestJSON-1860875757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9dcaeb85-fe58-451e-a2cd-ecc969680dd4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:25 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9dcaeb85-fe58-451e-a2cd-ecc969680dd4 Sep 28 17:06:25 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:25 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-295b806f-bdfd-43fb-9d4e-3098e856523f tempest-ServerRescueNegativeTestJSON-1860875757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9dcaeb85-fe58-451e-a2cd-ecc969680dd4" returned: 0 in 0.494s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:25 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-295b806f-bdfd-43fb-9d4e-3098e856523f tempest-ServerRescueNegativeTestJSON-1860875757 None] Lock "cinder-quobyte-9dcaeb85-fe58-451e-a2cd-ecc969680dd4" released by "delete_volume" :: held 1.844s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:25 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-295b806f-bdfd-43fb-9d4e-3098e856523f tempest-ServerRescueNegativeTestJSON-1860875757 None] Created reservations ['79dd5250-fa7c-4beb-b21d-946c929d7263', '4f6799c8-58e4-4644-899f-7a43508917a6', '45293ef8-7c6d-4df2-bb29-8b5665860b04', 'b09571e2-9e1d-4993-80ea-266495b87b44'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-295b806f-bdfd-43fb-9d4e-3098e856523f tempest-ServerRescueNegativeTestJSON-1860875757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-295b806f-bdfd-43fb-9d4e-3098e856523f tempest-ServerRescueNegativeTestJSON-1860875757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-295b806f-bdfd-43fb-9d4e-3098e856523f tempest-ServerRescueNegativeTestJSON-1860875757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-295b806f-bdfd-43fb-9d4e-3098e856523f tempest-ServerRescueNegativeTestJSON-1860875757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-295b806f-bdfd-43fb-9d4e-3098e856523f tempest-ServerRescueNegativeTestJSON-1860875757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-295b806f-bdfd-43fb-9d4e-3098e856523f tempest-ServerRescueNegativeTestJSON-1860875757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:26 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:06:26 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:26 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-295b806f-bdfd-43fb-9d4e-3098e856523f tempest-ServerRescueNegativeTestJSON-1860875757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.640s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:26 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-295b806f-bdfd-43fb-9d4e-3098e856523f tempest-ServerRescueNegativeTestJSON-1860875757 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:26 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-295b806f-bdfd-43fb-9d4e-3098e856523f tempest-ServerRescueNegativeTestJSON-1860875757 None] Deleted volume successfully. Sep 28 17:06:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-295b806f-bdfd-43fb-9d4e-3098e856523f tempest-ServerRescueNegativeTestJSON-1860875757 None] Lock "cinder-9dcaeb85-fe58-451e-a2cd-ecc969680dd4-delete_volume" released by "delete_volume" :: held 3.246s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:35 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Flow 'volume_create_manager' (33891c61-5d5e-4320-964c-6f2472a355b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4759e85-16f6-47a3-86bd-b4176a237e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4759e85-16f6-47a3-86bd-b4176a237e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-562184002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9122d659-538b-4f0f-ad2e-47bcfd73c955,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf2092b9aefa4f5790308efa525da9eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:35Z,use_quota=True,user_id='20881d27fb9049dd98d599c82d3ba453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88474ff5-c80e-4364-ad6f-cccc55d33ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88474ff5-c80e-4364-ad6f-cccc55d33ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcb98b2-7782-47b2-9765-e49a48ad7f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcb98b2-7782-47b2-9765-e49a48ad7f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9122d659-538b-4f0f-ad2e-47bcfd73c955', 'volume_name': 'volume-9122d659-538b-4f0f-ad2e-47bcfd73c955', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec029c4-25cb-4785-8d0c-832b5f5f2801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec029c4-25cb-4785-8d0c-832b5f5f2801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb0e81f-a2b2-4471-9e76-7ae410e6aa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:35 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Volume 9122d659-538b-4f0f-ad2e-47bcfd73c955: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9122d659-538b-4f0f-ad2e-47bcfd73c955', 'volume_size': 1} Sep 28 17:06:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-562184002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9122d659-538b-4f0f-ad2e-47bcfd73c955,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf2092b9aefa4f5790308efa525da9eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:35Z,use_quota=True,user_id='20881d27fb9049dd98d599c82d3ba453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:06:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Creating volume 9122d659-538b-4f0f-ad2e-47bcfd73c955 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:06:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:35 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:06:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9122d659-538b-4f0f-ad2e-47bcfd73c955 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:35 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9122d659-538b-4f0f-ad2e-47bcfd73c955 1073741824 Sep 28 17:06:35 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:36 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9122d659-538b-4f0f-ad2e-47bcfd73c955 1073741824" returned: 0 in 0.865s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9122d659-538b-4f0f-ad2e-47bcfd73c955 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:36 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9122d659-538b-4f0f-ad2e-47bcfd73c955 Sep 28 17:06:36 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:36 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9122d659-538b-4f0f-ad2e-47bcfd73c955" returned: 0 in 0.432s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:06:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb0e81f-a2b2-4471-9e76-7ae410e6aa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9122d659-538b-4f0f-ad2e-47bcfd73c955', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cffe3fb-749a-4837-8ff6-7c86ece33499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:37 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Volume volume-9122d659-538b-4f0f-ad2e-47bcfd73c955 (9122d659-538b-4f0f-ad2e-47bcfd73c955): created successfully Sep 28 17:06:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cffe3fb-749a-4837-8ff6-7c86ece33499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Flow 'volume_create_manager' (33891c61-5d5e-4320-964c-6f2472a355b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:37 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-8f5702dd-71ca-43c8-89a1-a756d20052f4 req-8dcab46b-3e42-41db-8441-d70fda6cc485 tempest-VolumesGetTestJSON-1345074814 None] Created volume successfully. Sep 28 17:06:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-c6924aec-b921-4dd4-9dec-bbe63ee3e5e2 req-0f1ccc72-8488-4815-9ada-e2d4502674be tempest-VolumesGetTestJSON-1345074814 None] Acquiring lock "cinder-9122d659-538b-4f0f-ad2e-47bcfd73c955-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-c6924aec-b921-4dd4-9dec-bbe63ee3e5e2 req-0f1ccc72-8488-4815-9ada-e2d4502674be tempest-VolumesGetTestJSON-1345074814 None] Lock "cinder-9122d659-538b-4f0f-ad2e-47bcfd73c955-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-c6924aec-b921-4dd4-9dec-bbe63ee3e5e2 req-0f1ccc72-8488-4815-9ada-e2d4502674be tempest-VolumesGetTestJSON-1345074814 None] Acquiring lock "cinder-quobyte-9122d659-538b-4f0f-ad2e-47bcfd73c955" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-c6924aec-b921-4dd4-9dec-bbe63ee3e5e2 req-0f1ccc72-8488-4815-9ada-e2d4502674be tempest-VolumesGetTestJSON-1345074814 None] Lock "cinder-quobyte-9122d659-538b-4f0f-ad2e-47bcfd73c955" acquired by "delete_volume" :: waited 0.044s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:40 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[3948c5ee-3329-446d-85de-e7d0cff9afc0]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-c6924aec-b921-4dd4-9dec-bbe63ee3e5e2 req-0f1ccc72-8488-4815-9ada-e2d4502674be tempest-VolumesGetTestJSON-1345074814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9122d659-538b-4f0f-ad2e-47bcfd73c955 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:40 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9122d659-538b-4f0f-ad2e-47bcfd73c955 Sep 28 17:06:40 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:40 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-c6924aec-b921-4dd4-9dec-bbe63ee3e5e2 req-0f1ccc72-8488-4815-9ada-e2d4502674be tempest-VolumesGetTestJSON-1345074814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9122d659-538b-4f0f-ad2e-47bcfd73c955" returned: 0 in 0.806s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-c6924aec-b921-4dd4-9dec-bbe63ee3e5e2 req-0f1ccc72-8488-4815-9ada-e2d4502674be tempest-VolumesGetTestJSON-1345074814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9122d659-538b-4f0f-ad2e-47bcfd73c955 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:41 devstack sudo[90408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9122d659-538b-4f0f-ad2e-47bcfd73c955 Sep 28 17:06:41 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:41 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-c6924aec-b921-4dd4-9dec-bbe63ee3e5e2 req-0f1ccc72-8488-4815-9ada-e2d4502674be tempest-VolumesGetTestJSON-1345074814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9122d659-538b-4f0f-ad2e-47bcfd73c955" returned: 0 in 0.433s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-c6924aec-b921-4dd4-9dec-bbe63ee3e5e2 req-0f1ccc72-8488-4815-9ada-e2d4502674be tempest-VolumesGetTestJSON-1345074814 None] Lock "cinder-quobyte-9122d659-538b-4f0f-ad2e-47bcfd73c955" released by "delete_volume" :: held 1.405s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:41 devstack cinder-volume[87061]: DEBUG cinder.quota [req-c6924aec-b921-4dd4-9dec-bbe63ee3e5e2 req-0f1ccc72-8488-4815-9ada-e2d4502674be tempest-VolumesGetTestJSON-1345074814 None] Created reservations ['8a7884e1-6b09-43e7-98b9-b9ff68117adf', '72ac7d48-8bd1-4b5d-99e9-144f8ed35c5e', 'a0eca87b-573d-4091-a970-cd6d1c8ec56a', '6050fb18-fa27-4190-8e24-1d318adc6574'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-c6924aec-b921-4dd4-9dec-bbe63ee3e5e2 req-0f1ccc72-8488-4815-9ada-e2d4502674be tempest-VolumesGetTestJSON-1345074814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-c6924aec-b921-4dd4-9dec-bbe63ee3e5e2 req-0f1ccc72-8488-4815-9ada-e2d4502674be tempest-VolumesGetTestJSON-1345074814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [req-c6924aec-b921-4dd4-9dec-bbe63ee3e5e2 req-0f1ccc72-8488-4815-9ada-e2d4502674be tempest-VolumesGetTestJSON-1345074814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [req-c6924aec-b921-4dd4-9dec-bbe63ee3e5e2 req-0f1ccc72-8488-4815-9ada-e2d4502674be tempest-VolumesGetTestJSON-1345074814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-c6924aec-b921-4dd4-9dec-bbe63ee3e5e2 req-0f1ccc72-8488-4815-9ada-e2d4502674be tempest-VolumesGetTestJSON-1345074814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-c6924aec-b921-4dd4-9dec-bbe63ee3e5e2 req-0f1ccc72-8488-4815-9ada-e2d4502674be tempest-VolumesGetTestJSON-1345074814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:41 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:06:41 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:42 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-c6924aec-b921-4dd4-9dec-bbe63ee3e5e2 req-0f1ccc72-8488-4815-9ada-e2d4502674be tempest-VolumesGetTestJSON-1345074814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.471s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:42 devstack cinder-volume[87061]: DEBUG cinder.manager [req-c6924aec-b921-4dd4-9dec-bbe63ee3e5e2 req-0f1ccc72-8488-4815-9ada-e2d4502674be tempest-VolumesGetTestJSON-1345074814 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:42 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-c6924aec-b921-4dd4-9dec-bbe63ee3e5e2 req-0f1ccc72-8488-4815-9ada-e2d4502674be tempest-VolumesGetTestJSON-1345074814 None] Deleted volume successfully. Sep 28 17:06:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-c6924aec-b921-4dd4-9dec-bbe63ee3e5e2 req-0f1ccc72-8488-4815-9ada-e2d4502674be tempest-VolumesGetTestJSON-1345074814 None] Lock "cinder-9122d659-538b-4f0f-ad2e-47bcfd73c955-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:51 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Flow 'volume_create_manager' (a43652a2-ac3b-4ecb-9335-95f0739c1621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9231ce-eb1f-49f4-ba76-abfcf20f11cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9231ce-eb1f-49f4-ba76-abfcf20f11cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-977544233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6cf8b4b21e4e338d9096226699641e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:52Z,use_quota=True,user_id='e8cf6dfa250d4c119554a0017720b04b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef80a04-ee03-48f1-85bc-a16bfc12c1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef80a04-ee03-48f1-85bc-a16bfc12c1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558bb90c-aa16-44ed-9cc9-6ed01aa75033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558bb90c-aa16-44ed-9cc9-6ed01aa75033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6', 'volume_name': 'volume-e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf37d26e-d00f-42f9-b301-e60762407a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf37d26e-d00f-42f9-b301-e60762407a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66990a3-38e2-4691-9067-854b7c0a0610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:51 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Volume e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6', 'volume_size': 1} Sep 28 17:06:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-977544233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6cf8b4b21e4e338d9096226699641e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:52Z,use_quota=True,user_id='e8cf6dfa250d4c119554a0017720b04b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:06:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Creating volume e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:06:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:51 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:06:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:51 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6 1073741824 Sep 28 17:06:51 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:52 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6 1073741824" returned: 0 in 0.793s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:52 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6 Sep 28 17:06:52 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:53 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6" returned: 0 in 0.295s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:06:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66990a3-38e2-4691-9067-854b7c0a0610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc9b84b-05fb-41c4-bca4-78bcecdb2d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:53 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Volume volume-e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6 (e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6): created successfully Sep 28 17:06:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc9b84b-05fb-41c4-bca4-78bcecdb2d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Flow 'volume_create_manager' (a43652a2-ac3b-4ecb-9335-95f0739c1621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:53 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-052aacb9-c986-4dde-8594-29e3eab58067 tempest-AttachVolumeShelveTestJSON-1974916074 None] Created volume successfully. Sep 28 17:06:57 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-675a5d55-d8f6-461f-afb9-a2cc810aa18b tempest-GroupSnapshotsTest-1785720431 None] Group tempest-GroupSnapshotsTest-Group-1491692012: creating Sep 28 17:06:57 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-675a5d55-d8f6-461f-afb9-a2cc810aa18b tempest-GroupSnapshotsTest-1785720431 None] Group tempest-GroupSnapshotsTest-Group-1491692012: created successfully Sep 28 17:06:57 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-675a5d55-d8f6-461f-afb9-a2cc810aa18b tempest-GroupSnapshotsTest-1785720431 None] Create group completed successfully. Sep 28 17:06:59 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Flow 'volume_create_manager' (2d70a35f-7fb4-4c2d-8b6a-5cd37863b8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b5e9363-1f5e-4cac-9928-9bb72c988da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b5e9363-1f5e-4cac-9928-9bb72c988da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1006305115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e5098f0-35d7-49a0-94ea-81af0638cff0,host='devstack@QuobyteHD#QuobyteHD',id=f2db4b09-7dfe-4937-a07f-622804abd391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81011936a31245df945eae30600680ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:59Z,use_quota=True,user_id='0ca9f9caaf864ad7be8e51c6f40f7045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32c6c437-6b8f-4c6a-afd2-826aecf3a71c),volume_type_id=32c6c437-6b8f-4c6a-afd2-826aecf3a71c)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360457b9-2e32-4dfd-82d4-b35c0e4c00eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360457b9-2e32-4dfd-82d4-b35c0e4c00eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48999fcd-10ea-431b-9765-308058cbcd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48999fcd-10ea-431b-9765-308058cbcd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2db4b09-7dfe-4937-a07f-622804abd391', 'volume_name': 'volume-f2db4b09-7dfe-4937-a07f-622804abd391', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62326820-decf-49ab-af1f-9b5170807213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62326820-decf-49ab-af1f-9b5170807213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c5fc29-9d66-4f1f-8fa9-831a87137d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:59 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Volume f2db4b09-7dfe-4937-a07f-622804abd391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2db4b09-7dfe-4937-a07f-622804abd391', 'volume_size': 1} Sep 28 17:06:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2e5098f0-35d7-49a0-94ea-81af0638cff0,created_at=2026-09-28T15:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1006305115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e5098f0-35d7-49a0-94ea-81af0638cff0,host='devstack@QuobyteHD#QuobyteHD',id=f2db4b09-7dfe-4937-a07f-622804abd391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81011936a31245df945eae30600680ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:59Z,use_quota=True,user_id='0ca9f9caaf864ad7be8e51c6f40f7045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32c6c437-6b8f-4c6a-afd2-826aecf3a71c),volume_type_id=32c6c437-6b8f-4c6a-afd2-826aecf3a71c)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:06:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Creating volume f2db4b09-7dfe-4937-a07f-622804abd391 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:06:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:59 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:06:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:59 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391 1073741824 Sep 28 17:06:59 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:00 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391 1073741824" returned: 0 in 0.589s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:00 devstack sudo[90524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391 Sep 28 17:07:00 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:00 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391" returned: 0 in 0.365s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:07:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c5fc29-9d66-4f1f-8fa9-831a87137d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2db4b09-7dfe-4937-a07f-622804abd391', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a0bd05-ae9e-4ed9-b9ee-3e873490d4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:00 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Volume volume-f2db4b09-7dfe-4937-a07f-622804abd391 (f2db4b09-7dfe-4937-a07f-622804abd391): created successfully Sep 28 17:07:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a0bd05-ae9e-4ed9-b9ee-3e873490d4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Flow 'volume_create_manager' (2d70a35f-7fb4-4c2d-8b6a-5cd37863b8c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:00 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-0ce6490c-3311-41db-9779-f93f72d3c35e tempest-GroupSnapshotsTest-1785720431 None] Created volume successfully. Sep 28 17:07:02 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d0b15be9-66e5-49fd-bafd-bb6a6cd5a5d9 tempest-GroupSnapshotsTest-1785720431 None] GroupSnapshot cf77a29b-da17-43a3-b3e5-e2ebfdd37892: creating. Sep 28 17:07:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d0b15be9-66e5-49fd-bafd-bb6a6cd5a5d9 tempest-GroupSnapshotsTest-1785720431 None] Group snapshot cf77a29b-da17-43a3-b3e5-e2ebfdd37892: creating. {{(pid=87061) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:07:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d0b15be9-66e5-49fd-bafd-bb6a6cd5a5d9 tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d0b15be9-66e5-49fd-bafd-bb6a6cd5a5d9 tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-d0b15be9-66e5-49fd-bafd-bb6a6cd5a5d9 tempest-GroupSnapshotsTest-1785720431 None] Creating offline snapshot 9a5a10b0-dacc-41ca-b79a-9334ca680e6f of volume f2db4b09-7dfe-4937-a07f-622804abd391 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:07:03 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11f7436-db0a-47bd-98d9-90c867e6619f]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0b15be9-66e5-49fd-bafd-bb6a6cd5a5d9 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:03 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391 Sep 28 17:07:03 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:03 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0b15be9-66e5-49fd-bafd-bb6a6cd5a5d9 tempest-GroupSnapshotsTest-1785720431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391" returned: 0 in 0.720s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0b15be9-66e5-49fd-bafd-bb6a6cd5a5d9 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:03 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f 1G Sep 28 17:07:03 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:04 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0b15be9-66e5-49fd-bafd-bb6a6cd5a5d9 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f 1G" returned: 0 in 0.751s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0b15be9-66e5-49fd-bafd-bb6a6cd5a5d9 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2db4b09-7dfe-4937-a07f-622804abd391 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:04 devstack sudo[90541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2db4b09-7dfe-4937-a07f-622804abd391 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f Sep 28 17:07:04 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:05 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0b15be9-66e5-49fd-bafd-bb6a6cd5a5d9 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2db4b09-7dfe-4937-a07f-622804abd391 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f" returned: 0 in 0.478s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:05 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-d0b15be9-66e5-49fd-bafd-bb6a6cd5a5d9 tempest-GroupSnapshotsTest-1785720431 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:07:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0b15be9-66e5-49fd-bafd-bb6a6cd5a5d9 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:05 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f Sep 28 17:07:05 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:05 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0b15be9-66e5-49fd-bafd-bb6a6cd5a5d9 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f" returned: 0 in 0.421s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0b15be9-66e5-49fd-bafd-bb6a6cd5a5d9 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:05 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.info Sep 28 17:07:05 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:05 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0b15be9-66e5-49fd-bafd-bb6a6cd5a5d9 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.info" returned: 0 in 0.448s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:05 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-d0b15be9-66e5-49fd-bafd-bb6a6cd5a5d9 tempest-GroupSnapshotsTest-1785720431 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:07:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0b15be9-66e5-49fd-bafd-bb6a6cd5a5d9 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:05 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.info Sep 28 17:07:05 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:06 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0b15be9-66e5-49fd-bafd-bb6a6cd5a5d9 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.info" returned: 0 in 0.462s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d0b15be9-66e5-49fd-bafd-bb6a6cd5a5d9 tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.479s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:07:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:06 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d0b15be9-66e5-49fd-bafd-bb6a6cd5a5d9 tempest-GroupSnapshotsTest-1785720431 None] group_snapshot cf77a29b-da17-43a3-b3e5-e2ebfdd37892: created successfully Sep 28 17:07:06 devstack sudo[90580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:07:06 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-fef01c96-0ffc-485e-9527-a350bd73a4c2 req-3ec7695b-4fae-4069-988c-fca0067d6fa2 tempest-ServerActionsTestOtherA-1604287769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-fef01c96-0ffc-485e-9527-a350bd73a4c2 req-3ec7695b-4fae-4069-988c-fca0067d6fa2 tempest-ServerActionsTestOtherA-1604287769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-fef01c96-0ffc-485e-9527-a350bd73a4c2 req-3ec7695b-4fae-4069-988c-fca0067d6fa2 tempest-ServerActionsTestOtherA-1604287769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-fef01c96-0ffc-485e-9527-a350bd73a4c2 req-3ec7695b-4fae-4069-988c-fca0067d6fa2 tempest-ServerActionsTestOtherA-1604287769 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-e50c351d-26a5-4f3e-ad62-e81f9b2c0154', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '013333b4-8f49-488e-b983-c9c58dd83fd2', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:07:07 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-fef01c96-0ffc-485e-9527-a350bd73a4c2 req-3ec7695b-4fae-4069-988c-fca0067d6fa2 tempest-ServerActionsTestOtherA-1604287769 None] attachment_update completed successfully. Sep 28 17:07:07 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.489s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:07:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:07:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 8 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:07:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:07:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:08 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "cinder-quobyte-9a5a10b0-dacc-41ca-b79a-9334ca680e6f-6305caae-4cc9-43b0-aa77-9e8af90ed291" by "_create_volume_from_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:08 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-9a5a10b0-dacc-41ca-b79a-9334ca680e6f-6305caae-4cc9-43b0-aa77-9e8af90ed291" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Creating volume 6305caae-4cc9-43b0-aa77-9e8af90ed291 from snapshot 9a5a10b0-dacc-41ca-b79a-9334ca680e6f {{(pid=87061) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:07:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:07:08 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "cinder-quobyte-6305caae-4cc9-43b0-aa77-9e8af90ed291" by "_copy_volume_from_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:08 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-6305caae-4cc9-43b0-aa77-9e8af90ed291" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] snapshot: 9a5a10b0-dacc-41ca-b79a-9334ca680e6f, volume: 6305caae-4cc9-43b0-aa77-9e8af90ed291, {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:07:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:09 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[36616dfd-f496-42dc-8465-4274cd6d027b]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:09 devstack sudo[91003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f Sep 28 17:07:09 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:09 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f" returned: 0 in 0.534s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2db4b09-7dfe-4937-a07f-622804abd391(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:07:09 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[774acedf-3b57-495c-97b1-132f8b621f4c]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:09 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391 Sep 28 17:07:09 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:10 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391" returned: 0 in 0.701s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391 {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:07:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Creating direct copy from snapshot {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:07:10 devstack cinder-volume[87061]: DEBUG cinder.utils [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Path /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6305caae-4cc9-43b0-aa77-9e8af90ed291 not found in is_blk_device check {{(pid=87061) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:07:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6305caae-4cc9-43b0-aa77-9e8af90ed291 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:10 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6305caae-4cc9-43b0-aa77-9e8af90ed291 Sep 28 17:07:10 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:15 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-0d02712d-0b21-42f3-936a-f6a2c1ece4fb req-746ccfb5-6431-4fbe-935c-853629821c20 tempest-ServerActionsTestOtherA-1604287769 None] Terminate volume connection completed successfully. Sep 28 17:07:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-0d02712d-0b21-42f3-936a-f6a2c1ece4fb req-746ccfb5-6431-4fbe-935c-853629821c20 tempest-ServerActionsTestOtherA-1604287769 None] Deleting attachment 013333b4-8f49-488e-b983-c9c58dd83fd2. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:07:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-3a459c32-1b25-41a2-9308-ce00c048a40f req-72e0f7f1-23c2-489c-a671-bf487043d54d tempest-AttachVolumeShelveTestJSON-1974916074 None] No connector for attachment 705c8102-cb73-4eef-a7ae-2d9dda35bf44; skipping storage backend terminate_connection call. {{(pid=87061) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 17:07:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-3a459c32-1b25-41a2-9308-ce00c048a40f req-72e0f7f1-23c2-489c-a671-bf487043d54d tempest-AttachVolumeShelveTestJSON-1974916074 None] Deleting attachment 705c8102-cb73-4eef-a7ae-2d9dda35bf44. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:07:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-0d02712d-0b21-42f3-936a-f6a2c1ece4fb req-9c95955c-6f3a-4215-9fb0-d5fd5df038e6 tempest-ServerActionsTestOtherA-1604287769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:23 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6305caae-4cc9-43b0-aa77-9e8af90ed291" returned: 0 in 12.638s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:23 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Image conversion details: src /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391, size 1024.00 MB, duration 12.64 sec, destination /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6305caae-4cc9-43b0-aa77-9e8af90ed291 {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:07:23 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Converted 1024.00 MB image at 81.02 MB/s Sep 28 17:07:23 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6305caae-4cc9-43b0-aa77-9e8af90ed291 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:07:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6305caae-4cc9-43b0-aa77-9e8af90ed291 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:23 devstack sudo[91171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6305caae-4cc9-43b0-aa77-9e8af90ed291 Sep 28 17:07:23 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:23 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6305caae-4cc9-43b0-aa77-9e8af90ed291" returned: 0 in 0.665s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-6305caae-4cc9-43b0-aa77-9e8af90ed291" released by "_copy_volume_from_snapshot" :: held 14.782s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:23 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=30,cinder:UPDATE=34,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:07:23 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=43,cinder:INSERT=6,cinder:UPDATE=27,cinder:DELETE=3 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:07:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-9a5a10b0-dacc-41ca-b79a-9334ca680e6f-6305caae-4cc9-43b0-aa77-9e8af90ed291" released by "_create_volume_from_snapshot" :: held 14.948s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.983s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-0d02712d-0b21-42f3-936a-f6a2c1ece4fb req-9c95955c-6f3a-4215-9fb0-d5fd5df038e6 tempest-ServerActionsTestOtherA-1604287769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.668s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-0d02712d-0b21-42f3-936a-f6a2c1ece4fb req-9c95955c-6f3a-4215-9fb0-d5fd5df038e6 tempest-ServerActionsTestOtherA-1604287769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-0d02712d-0b21-42f3-936a-f6a2c1ece4fb req-9c95955c-6f3a-4215-9fb0-d5fd5df038e6 tempest-ServerActionsTestOtherA-1604287769 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-e50c351d-26a5-4f3e-ad62-e81f9b2c0154', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '482b6af5-44a0-4de3-85c1-5219e427ae0f', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:07:24 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-649e5682-eaac-47ce-9220-500f5cd8b22d tempest-GroupSnapshotsTest-1785720431 None] Create group from source-snapshot-cf77a29b-da17-43a3-b3e5-e2ebfdd37892 completed successfully. Sep 28 17:07:24 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-0d02712d-0b21-42f3-936a-f6a2c1ece4fb req-9c95955c-6f3a-4215-9fb0-d5fd5df038e6 tempest-ServerActionsTestOtherA-1604287769 None] attachment_update completed successfully. Sep 28 17:07:25 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1003c480-4d6c-4bda-a8c4-567bc83023b7 tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "cinder-quobyte-6305caae-4cc9-43b0-aa77-9e8af90ed291" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:25 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1003c480-4d6c-4bda-a8c4-567bc83023b7 tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-6305caae-4cc9-43b0-aa77-9e8af90ed291" acquired by "delete_volume" :: waited 0.046s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:25 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f57fb0-f6c1-4f72-a4d6-0b278bc6575c]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1003c480-4d6c-4bda-a8c4-567bc83023b7 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6305caae-4cc9-43b0-aa77-9e8af90ed291 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:25 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6305caae-4cc9-43b0-aa77-9e8af90ed291 Sep 28 17:07:25 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:26 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1003c480-4d6c-4bda-a8c4-567bc83023b7 tempest-GroupSnapshotsTest-1785720431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6305caae-4cc9-43b0-aa77-9e8af90ed291" returned: 0 in 0.787s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1003c480-4d6c-4bda-a8c4-567bc83023b7 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6305caae-4cc9-43b0-aa77-9e8af90ed291 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:26 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6305caae-4cc9-43b0-aa77-9e8af90ed291 Sep 28 17:07:26 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:27 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1003c480-4d6c-4bda-a8c4-567bc83023b7 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6305caae-4cc9-43b0-aa77-9e8af90ed291" returned: 0 in 1.059s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:27 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1003c480-4d6c-4bda-a8c4-567bc83023b7 tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-6305caae-4cc9-43b0-aa77-9e8af90ed291" released by "delete_volume" :: held 2.009s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:27 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-1003c480-4d6c-4bda-a8c4-567bc83023b7 tempest-GroupSnapshotsTest-1785720431 None] Created reservations ['1d406be9-e865-4d58-a216-2bfd59d378f6'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:27 devstack cinder-volume[87061]: WARNING cinder.quota [None req-1003c480-4d6c-4bda-a8c4-567bc83023b7 tempest-GroupSnapshotsTest-1785720431 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2017045842 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2017045842, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:07:27 devstack cinder-volume[87061]: WARNING cinder.quota [None req-1003c480-4d6c-4bda-a8c4-567bc83023b7 tempest-GroupSnapshotsTest-1785720431 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2017045842 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2017045842, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:07:28 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-1003c480-4d6c-4bda-a8c4-567bc83023b7 tempest-GroupSnapshotsTest-1785720431 None] Created reservations ['f284b04f-2d14-4f12-a523-143e3b3c9cd6', 'e3e1cc16-afea-4e02-ae46-131ff472eeb6', '6198f0e8-e524-4200-b687-cd0b34029c34', '2f4b677e-b49b-4569-913f-5857446bd923'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1003c480-4d6c-4bda-a8c4-567bc83023b7 tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1003c480-4d6c-4bda-a8c4-567bc83023b7 tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1003c480-4d6c-4bda-a8c4-567bc83023b7 tempest-GroupSnapshotsTest-1785720431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1003c480-4d6c-4bda-a8c4-567bc83023b7 tempest-GroupSnapshotsTest-1785720431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1003c480-4d6c-4bda-a8c4-567bc83023b7 tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1003c480-4d6c-4bda-a8c4-567bc83023b7 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:28 devstack sudo[91715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:07:28 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:28 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1003c480-4d6c-4bda-a8c4-567bc83023b7 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.513s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:28 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1003c480-4d6c-4bda-a8c4-567bc83023b7 tempest-GroupSnapshotsTest-1785720431 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:07:29 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-1003c480-4d6c-4bda-a8c4-567bc83023b7 tempest-GroupSnapshotsTest-1785720431 None] Delete group completed successfully. Sep 28 17:07:29 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-c82ed33b-561b-47cb-8da7-876395f7a249 tempest-GroupSnapshotsTest-1785720431 None] group_snapshot cf77a29b-da17-43a3-b3e5-e2ebfdd37892: deleting Sep 28 17:07:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c82ed33b-561b-47cb-8da7-876395f7a249 tempest-GroupSnapshotsTest-1785720431 None] group_snapshot cf77a29b-da17-43a3-b3e5-e2ebfdd37892: deleting {{(pid=87061) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:07:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c82ed33b-561b-47cb-8da7-876395f7a249 tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "cinder-quobyte-f2db4b09-7dfe-4937-a07f-622804abd391" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c82ed33b-561b-47cb-8da7-876395f7a249 tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-f2db4b09-7dfe-4937-a07f-622804abd391" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c82ed33b-561b-47cb-8da7-876395f7a249 tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "cinder-quobyte-9a5a10b0-dacc-41ca-b79a-9334ca680e6f" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c82ed33b-561b-47cb-8da7-876395f7a249 tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-9a5a10b0-dacc-41ca-b79a-9334ca680e6f" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-c82ed33b-561b-47cb-8da7-876395f7a249 tempest-GroupSnapshotsTest-1785720431 None] Deleting offline snapshot 9a5a10b0-dacc-41ca-b79a-9334ca680e6f of volume f2db4b09-7dfe-4937-a07f-622804abd391 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:07:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-c82ed33b-561b-47cb-8da7-876395f7a249 tempest-GroupSnapshotsTest-1785720431 None] snapshot_file for this snap is: volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:07:29 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[619b0552-fb75-4473-92a8-402a35bf8877]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c82ed33b-561b-47cb-8da7-876395f7a249 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:29 devstack sudo[91731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f Sep 28 17:07:29 devstack sudo[91731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:30 devstack sudo[91731]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c82ed33b-561b-47cb-8da7-876395f7a249 tempest-GroupSnapshotsTest-1785720431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f" returned: 0 in 1.087s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:30 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-c82ed33b-561b-47cb-8da7-876395f7a249 tempest-GroupSnapshotsTest-1785720431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2db4b09-7dfe-4937-a07f-622804abd391(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:07:30 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dd91a1-7401-4dad-87ac-f311c7921413]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c82ed33b-561b-47cb-8da7-876395f7a249 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:31 devstack sudo[91755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391 Sep 28 17:07:31 devstack sudo[91755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:32 devstack sudo[91755]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c82ed33b-561b-47cb-8da7-876395f7a249 tempest-GroupSnapshotsTest-1785720431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391" returned: 0 in 1.337s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c82ed33b-561b-47cb-8da7-876395f7a249 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:32 devstack sudo[91768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f Sep 28 17:07:32 devstack sudo[91768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:33 devstack sudo[91768]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c82ed33b-561b-47cb-8da7-876395f7a249 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f" returned: 0 in 1.354s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c82ed33b-561b-47cb-8da7-876395f7a249 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:33 devstack sudo[91779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f Sep 28 17:07:33 devstack sudo[91779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c82ed33b-561b-47cb-8da7-876395f7a249 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391.9a5a10b0-dacc-41ca-b79a-9334ca680e6f" returned: 0 in 1.383s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:34 devstack sudo[91779]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:35 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c82ed33b-561b-47cb-8da7-876395f7a249 tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-9a5a10b0-dacc-41ca-b79a-9334ca680e6f" released by "_delete_snapshot" :: held 5.545s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:35 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c82ed33b-561b-47cb-8da7-876395f7a249 tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-f2db4b09-7dfe-4937-a07f-622804abd391" released by "delete_snapshot" :: held 5.636s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:35 devstack cinder-volume[87061]: WARNING cinder.quota [None req-c82ed33b-561b-47cb-8da7-876395f7a249 tempest-GroupSnapshotsTest-1785720431 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2017045842 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2017045842, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:07:35 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-c82ed33b-561b-47cb-8da7-876395f7a249 tempest-GroupSnapshotsTest-1785720431 None] Created reservations ['9cb1a5ca-b768-4bec-8540-630fcfaadc8d', 'ea57f412-657e-40d1-85a9-f3f8dfd9fca8', '55bbccc6-d0d7-42f5-8970-d5ae22aea617', 'd9e19b22-e277-4991-ad34-1a06cd714dc5'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:35 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-c82ed33b-561b-47cb-8da7-876395f7a249 tempest-GroupSnapshotsTest-1785720431 None] group_snapshot cf77a29b-da17-43a3-b3e5-e2ebfdd37892: deleted successfully Sep 28 17:07:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c111e4ef-09b1-45d4-b4dc-7565f4ddd579 tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "cinder-quobyte-f2db4b09-7dfe-4937-a07f-622804abd391" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c111e4ef-09b1-45d4-b4dc-7565f4ddd579 tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-f2db4b09-7dfe-4937-a07f-622804abd391" acquired by "delete_volume" :: waited 0.070s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:37 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5945f778-492b-4e8a-9156-f80005aba043]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c111e4ef-09b1-45d4-b4dc-7565f4ddd579 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:37 devstack sudo[91785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391 Sep 28 17:07:37 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:38 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c111e4ef-09b1-45d4-b4dc-7565f4ddd579 tempest-GroupSnapshotsTest-1785720431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391" returned: 0 in 1.278s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c111e4ef-09b1-45d4-b4dc-7565f4ddd579 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:38 devstack sudo[91802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391 Sep 28 17:07:38 devstack sudo[91802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:38 devstack sudo[91802]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c111e4ef-09b1-45d4-b4dc-7565f4ddd579 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f2db4b09-7dfe-4937-a07f-622804abd391" returned: 0 in 0.606s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c111e4ef-09b1-45d4-b4dc-7565f4ddd579 tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-f2db4b09-7dfe-4937-a07f-622804abd391" released by "delete_volume" :: held 2.150s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:39 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-c111e4ef-09b1-45d4-b4dc-7565f4ddd579 tempest-GroupSnapshotsTest-1785720431 None] Created reservations ['0474cdc8-fa2d-4f58-9e3e-47e41e2f6655'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:39 devstack cinder-volume[87061]: WARNING cinder.db.api [None req-c111e4ef-09b1-45d4-b4dc-7565f4ddd579 tempest-GroupSnapshotsTest-1785720431 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2017045842'] Sep 28 17:07:39 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-c111e4ef-09b1-45d4-b4dc-7565f4ddd579 tempest-GroupSnapshotsTest-1785720431 None] Created reservations ['2dffa8dd-dee1-46b5-b193-248d3c81fbe6', '85e3f1c0-4efd-4883-8c48-ae65a4f92a15', '3f6b101f-5007-401e-bf9f-a2bf8eb03526', '3d6e858e-d564-433f-9331-7cd6f30b1398'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c111e4ef-09b1-45d4-b4dc-7565f4ddd579 tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c111e4ef-09b1-45d4-b4dc-7565f4ddd579 tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c111e4ef-09b1-45d4-b4dc-7565f4ddd579 tempest-GroupSnapshotsTest-1785720431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c111e4ef-09b1-45d4-b4dc-7565f4ddd579 tempest-GroupSnapshotsTest-1785720431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c111e4ef-09b1-45d4-b4dc-7565f4ddd579 tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c111e4ef-09b1-45d4-b4dc-7565f4ddd579 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:40 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:07:40 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:40 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c111e4ef-09b1-45d4-b4dc-7565f4ddd579 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 1.051s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:40 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-c111e4ef-09b1-45d4-b4dc-7565f4ddd579 tempest-GroupSnapshotsTest-1785720431 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:07:40 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-c111e4ef-09b1-45d4-b4dc-7565f4ddd579 tempest-GroupSnapshotsTest-1785720431 None] Delete group completed successfully. Sep 28 17:07:42 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-45b295e8-c9fb-4de1-bdfd-db2a6585d8d5 tempest-GroupSnapshotsTest-1785720431 None] Group tempest-GroupSnapshotsTest-Group-527723141: creating Sep 28 17:07:42 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-45b295e8-c9fb-4de1-bdfd-db2a6585d8d5 tempest-GroupSnapshotsTest-1785720431 None] Group tempest-GroupSnapshotsTest-Group-527723141: created successfully Sep 28 17:07:42 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-45b295e8-c9fb-4de1-bdfd-db2a6585d8d5 tempest-GroupSnapshotsTest-1785720431 None] Create group completed successfully. Sep 28 17:07:45 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:07:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Flow 'volume_create_manager' (34ab593b-cc9f-453c-be9c-345ca8732c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f7dfadc-4ab0-44ef-8f2f-c9bfc7ce62e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f7dfadc-4ab0-44ef-8f2f-c9bfc7ce62e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1182173844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d670c30-8fdf-4f42-8880-0a2eaba72d46,host='devstack@QuobyteHD#QuobyteHD',id=9698d9c4-e394-4986-8d62-4ccfbbe32a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81011936a31245df945eae30600680ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:45Z,use_quota=True,user_id='0ca9f9caaf864ad7be8e51c6f40f7045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2eb5089e-920e-40f3-933f-a27ba565561d),volume_type_id=2eb5089e-920e-40f3-933f-a27ba565561d)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9397af-a0f6-4598-8362-9ea8bb6c6b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9397af-a0f6-4598-8362-9ea8bb6c6b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5a3f50a-da7b-431c-932b-16eac311ef41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5a3f50a-da7b-431c-932b-16eac311ef41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9698d9c4-e394-4986-8d62-4ccfbbe32a7a', 'volume_name': 'volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55124963-dc67-46da-8654-a95319e65f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55124963-dc67-46da-8654-a95319e65f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76e9501-6b0c-4785-9483-26f869e5bb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:45 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Volume 9698d9c4-e394-4986-8d62-4ccfbbe32a7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a', 'volume_size': 1} Sep 28 17:07:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8d670c30-8fdf-4f42-8880-0a2eaba72d46,created_at=2026-09-28T15:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1182173844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d670c30-8fdf-4f42-8880-0a2eaba72d46,host='devstack@QuobyteHD#QuobyteHD',id=9698d9c4-e394-4986-8d62-4ccfbbe32a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81011936a31245df945eae30600680ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:45Z,use_quota=True,user_id='0ca9f9caaf864ad7be8e51c6f40f7045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2eb5089e-920e-40f3-933f-a27ba565561d),volume_type_id=2eb5089e-920e-40f3-933f-a27ba565561d)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:07:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Creating volume 9698d9c4-e394-4986-8d62-4ccfbbe32a7a {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:07:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:07:45 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:07:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:45 devstack sudo[91908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a 1073741824 Sep 28 17:07:45 devstack sudo[91908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:46 devstack sudo[91908]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a 1073741824" returned: 0 in 1.384s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:47 devstack sudo[91988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a Sep 28 17:07:47 devstack sudo[91988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:47 devstack sudo[91988]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a" returned: 0 in 0.819s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] <== create_volume: return (2390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:07:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.402s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76e9501-6b0c-4785-9483-26f869e5bb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bedce24-2e83-466f-8c2b-b1ec377a6e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:48 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Volume volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a (9698d9c4-e394-4986-8d62-4ccfbbe32a7a): created successfully Sep 28 17:07:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bedce24-2e83-466f-8c2b-b1ec377a6e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Flow 'volume_create_manager' (34ab593b-cc9f-453c-be9c-345ca8732c92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:48 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-8994e4bd-ef54-4e71-8ea6-36ad60f967cf tempest-GroupSnapshotsTest-1785720431 None] Created volume successfully. Sep 28 17:07:49 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:07:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Flow 'volume_create_manager' (ac34baba-2b67-4fd3-9dbb-3430da8aceb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb84e40-fd0d-428c-bf48-957eaf4eacc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb84e40-fd0d-428c-bf48-957eaf4eacc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-701992505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d670c30-8fdf-4f42-8880-0a2eaba72d46,host='devstack@QuobyteHD#QuobyteHD',id=75085f66-15bc-428d-baf1-7d467a35e7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81011936a31245df945eae30600680ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:50Z,use_quota=True,user_id='0ca9f9caaf864ad7be8e51c6f40f7045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2eb5089e-920e-40f3-933f-a27ba565561d),volume_type_id=2eb5089e-920e-40f3-933f-a27ba565561d)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c177598-6e3f-4346-a933-307d9786ca1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c177598-6e3f-4346-a933-307d9786ca1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:50 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28bd05f2-3f0c-4fe6-8d52-e238fe93e229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:50 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28bd05f2-3f0c-4fe6-8d52-e238fe93e229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75085f66-15bc-428d-baf1-7d467a35e7a4', 'volume_name': 'volume-75085f66-15bc-428d-baf1-7d467a35e7a4', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:50 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c3b723-61f0-4a4a-b7ce-401d38ab465a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:50 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c3b723-61f0-4a4a-b7ce-401d38ab465a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:50 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f288ace-f191-4ce7-add0-1abe11c74da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:50 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Volume 75085f66-15bc-428d-baf1-7d467a35e7a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75085f66-15bc-428d-baf1-7d467a35e7a4', 'volume_size': 1} Sep 28 17:07:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:50 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8d670c30-8fdf-4f42-8880-0a2eaba72d46,created_at=2026-09-28T15:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-701992505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d670c30-8fdf-4f42-8880-0a2eaba72d46,host='devstack@QuobyteHD#QuobyteHD',id=75085f66-15bc-428d-baf1-7d467a35e7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81011936a31245df945eae30600680ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:50Z,use_quota=True,user_id='0ca9f9caaf864ad7be8e51c6f40f7045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2eb5089e-920e-40f3-933f-a27ba565561d),volume_type_id=2eb5089e-920e-40f3-933f-a27ba565561d)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:07:50 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Creating volume 75085f66-15bc-428d-baf1-7d467a35e7a4 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:07:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:50 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:50 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:50 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:07:50 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:07:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:50 devstack sudo[92090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4 1073741824 Sep 28 17:07:50 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:50 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4 1073741824" returned: 0 in 0.920s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:51 devstack sudo[92122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4 Sep 28 17:07:51 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:52 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4" returned: 0 in 1.133s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:52 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] <== create_volume: return (2171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:07:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.174s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:52 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f288ace-f191-4ce7-add0-1abe11c74da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75085f66-15bc-428d-baf1-7d467a35e7a4', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:52 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b9f291-4b7f-4d23-a788-d29d3f0b1778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:52 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Volume volume-75085f66-15bc-428d-baf1-7d467a35e7a4 (75085f66-15bc-428d-baf1-7d467a35e7a4): created successfully Sep 28 17:07:52 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b9f291-4b7f-4d23-a788-d29d3f0b1778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:52 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Flow 'volume_create_manager' (ac34baba-2b67-4fd3-9dbb-3430da8aceb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:52 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-267484ca-250f-4bf9-af4a-521e5634afe1 tempest-GroupSnapshotsTest-1785720431 None] Created volume successfully. Sep 28 17:07:53 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-cb1260ac-9f30-44ff-af5c-589eed009c32 tempest-GroupSnapshotsTest-1785720431 None] Update group completed successfully. Sep 28 17:07:54 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-0b2c9b7b-9d2f-431d-a34b-e71c122955f2 tempest-GroupSnapshotsTest-1785720431 None] Update group completed successfully. Sep 28 17:07:56 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-93f7ce69-ae30-4033-9f82-06ec7b298c16 tempest-GroupSnapshotsTest-1785720431 None] Update group completed successfully. Sep 28 17:07:57 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-aa89f027-eb99-4e74-9072-4d2d110274c5 tempest-GroupSnapshotsTest-1785720431 None] Update group completed successfully. Sep 28 17:07:58 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:07:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Flow 'volume_create_manager' (65581f8e-ef3a-435c-842a-b4a1c7e141d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccd0b79-8b17-478b-9c12-e82633919ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccd0b79-8b17-478b-9c12-e82633919ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1869052224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f4cbc96-0758-447f-bb6a-7d5dcf4541d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b73985239645b486495baebe39e9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:59Z,use_quota=True,user_id='c52bcab043c049ba93aa4473c1448ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9152091c-fcd4-4bab-99cf-ee0e77927085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9152091c-fcd4-4bab-99cf-ee0e77927085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee310d47-e0b6-464f-a458-e1b6e68037c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee310d47-e0b6-464f-a458-e1b6e68037c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f4cbc96-0758-447f-bb6a-7d5dcf4541d2', 'volume_name': 'volume-4f4cbc96-0758-447f-bb6a-7d5dcf4541d2', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560ed5a8-6474-4275-ac63-b86fad0cd05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560ed5a8-6474-4275-ac63-b86fad0cd05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (626ee651-6239-49bf-b576-ecbfa71ccbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:59 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Volume 4f4cbc96-0758-447f-bb6a-7d5dcf4541d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f4cbc96-0758-447f-bb6a-7d5dcf4541d2', 'volume_size': 1} Sep 28 17:07:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1869052224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f4cbc96-0758-447f-bb6a-7d5dcf4541d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b73985239645b486495baebe39e9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:59Z,use_quota=True,user_id='c52bcab043c049ba93aa4473c1448ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:07:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Creating volume 4f4cbc96-0758-447f-bb6a-7d5dcf4541d2 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:07:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:07:59 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:07:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4f4cbc96-0758-447f-bb6a-7d5dcf4541d2 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:59 devstack sudo[92199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4f4cbc96-0758-447f-bb6a-7d5dcf4541d2 1073741824 Sep 28 17:07:59 devstack sudo[92199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:59 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] GroupSnapshot 6f9c66a1-6a7e-4ec4-b0a8-2b31ae07edd1: creating. Sep 28 17:07:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] Group snapshot 6f9c66a1-6a7e-4ec4-b0a8-2b31ae07edd1: creating. {{(pid=87061) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:07:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:59 devstack sudo[92199]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4f4cbc96-0758-447f-bb6a-7d5dcf4541d2 1073741824" returned: 0 in 0.763s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4f4cbc96-0758-447f-bb6a-7d5dcf4541d2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:59 devstack sudo[92205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4f4cbc96-0758-447f-bb6a-7d5dcf4541d2 Sep 28 17:07:59 devstack sudo[92205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:00 devstack sudo[92205]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4f4cbc96-0758-447f-bb6a-7d5dcf4541d2" returned: 0 in 0.401s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.618s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (626ee651-6239-49bf-b576-ecbfa71ccbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f4cbc96-0758-447f-bb6a-7d5dcf4541d2', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b777154-aca0-4c78-ae35-37e3a29a33b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] Creating offline snapshot 7f5c5adb-47fe-44da-8cbf-fa516f5e413a of volume 9698d9c4-e394-4986-8d62-4ccfbbe32a7a {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:08:00 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Volume volume-4f4cbc96-0758-447f-bb6a-7d5dcf4541d2 (4f4cbc96-0758-447f-bb6a-7d5dcf4541d2): created successfully Sep 28 17:08:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b777154-aca0-4c78-ae35-37e3a29a33b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Flow 'volume_create_manager' (65581f8e-ef3a-435c-842a-b4a1c7e141d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:00 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa27657-721c-45b5-8f6b-fe66f5329d2e]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:00 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d35deedd-789f-47d8-8773-5a4628772165 tempest-ServersNegativeTestJSON-340790296 None] Created volume successfully. Sep 28 17:08:00 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a Sep 28 17:08:00 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:00 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a" returned: 0 in 0.493s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.7f5c5adb-47fe-44da-8cbf-fa516f5e413a 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:00 devstack sudo[92214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.7f5c5adb-47fe-44da-8cbf-fa516f5e413a 1G Sep 28 17:08:00 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:01 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.7f5c5adb-47fe-44da-8cbf-fa516f5e413a 1G" returned: 0 in 0.621s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.7f5c5adb-47fe-44da-8cbf-fa516f5e413a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:01 devstack sudo[92220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.7f5c5adb-47fe-44da-8cbf-fa516f5e413a Sep 28 17:08:01 devstack sudo[92220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:01 devstack sudo[92220]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.7f5c5adb-47fe-44da-8cbf-fa516f5e413a" returned: 0 in 0.431s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:01 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.7f5c5adb-47fe-44da-8cbf-fa516f5e413a is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:08:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.7f5c5adb-47fe-44da-8cbf-fa516f5e413a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:01 devstack sudo[92225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.7f5c5adb-47fe-44da-8cbf-fa516f5e413a Sep 28 17:08:01 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:02 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.7f5c5adb-47fe-44da-8cbf-fa516f5e413a" returned: 0 in 0.374s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:02 devstack sudo[92228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.info Sep 28 17:08:02 devstack sudo[92228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:02 devstack sudo[92228]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.info" returned: 0 in 0.460s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:02 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:08:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:02 devstack sudo[92231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.info Sep 28 17:08:02 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:02 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Flow 'volume_create_manager' (19eeb676-ed74-4617-9acb-6ea043da35f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b961e409-e49d-4437-aef9-8ad6dd87ee1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b961e409-e49d-4437-aef9-8ad6dd87ee1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1789232218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f80a19-53eb-4194-9c6a-e325d9fef8c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b73985239645b486495baebe39e9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:03Z,use_quota=True,user_id='c52bcab043c049ba93aa4473c1448ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6effba84-1328-433b-8c13-6fefe74b72a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6effba84-1328-433b-8c13-6fefe74b72a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a684a83-3532-4fb9-88a5-cc7bd66fd073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a684a83-3532-4fb9-88a5-cc7bd66fd073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99f80a19-53eb-4194-9c6a-e325d9fef8c7', 'volume_name': 'volume-99f80a19-53eb-4194-9c6a-e325d9fef8c7', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee04b49-74e5-4f12-b06a-e42ecb7c6097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee04b49-74e5-4f12-b06a-e42ecb7c6097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a8b155-cec8-494b-9193-8b6a573fffb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:03 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Volume 99f80a19-53eb-4194-9c6a-e325d9fef8c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99f80a19-53eb-4194-9c6a-e325d9fef8c7', 'volume_size': 1} Sep 28 17:08:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:03 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.info" returned: 0 in 0.390s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.932s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] Creating offline snapshot 80938f0e-6897-4034-9d80-281086d0b5ba of volume 75085f66-15bc-428d-baf1-7d467a35e7a4 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:08:03 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f4689d-fa55-45f4-ab53-100cd1653dfc]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:03 devstack sudo[92235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4 Sep 28 17:08:03 devstack sudo[92235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:03 devstack sudo[92235]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4" returned: 0 in 0.476s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.80938f0e-6897-4034-9d80-281086d0b5ba 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:03 devstack sudo[92240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.80938f0e-6897-4034-9d80-281086d0b5ba 1G Sep 28 17:08:03 devstack sudo[92240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:04 devstack sudo[92240]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.80938f0e-6897-4034-9d80-281086d0b5ba 1G" returned: 0 in 0.502s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75085f66-15bc-428d-baf1-7d467a35e7a4 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.80938f0e-6897-4034-9d80-281086d0b5ba {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:04 devstack sudo[92245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75085f66-15bc-428d-baf1-7d467a35e7a4 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.80938f0e-6897-4034-9d80-281086d0b5ba Sep 28 17:08:04 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:04 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75085f66-15bc-428d-baf1-7d467a35e7a4 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.80938f0e-6897-4034-9d80-281086d0b5ba" returned: 0 in 0.334s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:04 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.80938f0e-6897-4034-9d80-281086d0b5ba is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:08:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.80938f0e-6897-4034-9d80-281086d0b5ba {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:04 devstack sudo[92250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.80938f0e-6897-4034-9d80-281086d0b5ba Sep 28 17:08:04 devstack sudo[92250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:04 devstack sudo[92250]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.80938f0e-6897-4034-9d80-281086d0b5ba" returned: 0 in 0.305s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:04 devstack sudo[92254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.info Sep 28 17:08:04 devstack sudo[92254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:05 devstack sudo[92254]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.info" returned: 0 in 0.344s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:05 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:08:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:05 devstack sudo[92257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.info Sep 28 17:08:05 devstack sudo[92257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:05 devstack sudo[92257]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.info" returned: 0 in 0.262s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.353s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.516s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1789232218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f80a19-53eb-4194-9c6a-e325d9fef8c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b73985239645b486495baebe39e9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:03Z,use_quota=True,user_id='c52bcab043c049ba93aa4473c1448ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Creating volume 99f80a19-53eb-4194-9c6a-e325d9fef8c7 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:05 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:08:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-99f80a19-53eb-4194-9c6a-e325d9fef8c7 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:05 devstack sudo[92260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-99f80a19-53eb-4194-9c6a-e325d9fef8c7 1073741824 Sep 28 17:08:05 devstack sudo[92260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:05 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-4d25516f-e7e8-45f4-856f-42832a1eebd4 tempest-GroupSnapshotsTest-1785720431 None] group_snapshot 6f9c66a1-6a7e-4ec4-b0a8-2b31ae07edd1: created successfully Sep 28 17:08:06 devstack sudo[92260]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-99f80a19-53eb-4194-9c6a-e325d9fef8c7 1073741824" returned: 0 in 0.670s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:06 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] group_snapshot 6f9c66a1-6a7e-4ec4-b0a8-2b31ae07edd1: deleting Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] group_snapshot 6f9c66a1-6a7e-4ec4-b0a8-2b31ae07edd1: deleting {{(pid=87061) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-99f80a19-53eb-4194-9c6a-e325d9fef8c7 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:06 devstack sudo[92266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-99f80a19-53eb-4194-9c6a-e325d9fef8c7 Sep 28 17:08:06 devstack sudo[92266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "cinder-quobyte-9698d9c4-e394-4986-8d62-4ccfbbe32a7a" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-9698d9c4-e394-4986-8d62-4ccfbbe32a7a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "cinder-quobyte-7f5c5adb-47fe-44da-8cbf-fa516f5e413a" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-7f5c5adb-47fe-44da-8cbf-fa516f5e413a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Deleting offline snapshot 7f5c5adb-47fe-44da-8cbf-fa516f5e413a of volume 9698d9c4-e394-4986-8d62-4ccfbbe32a7a {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] snapshot_file for this snap is: volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.7f5c5adb-47fe-44da-8cbf-fa516f5e413a {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b5d335-9737-4f5c-bc12-110ff74186af]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.7f5c5adb-47fe-44da-8cbf-fa516f5e413a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:06 devstack sudo[92268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.7f5c5adb-47fe-44da-8cbf-fa516f5e413a Sep 28 17:08:06 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:06 devstack sudo[92266]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-99f80a19-53eb-4194-9c6a-e325d9fef8c7" returned: 0 in 0.367s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a8b155-cec8-494b-9193-8b6a573fffb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99f80a19-53eb-4194-9c6a-e325d9fef8c7', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea533884-6a1c-4f57-81fc-8b3f3f4d5106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:06 devstack sudo[92272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:08:06 devstack sudo[92272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:06 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Volume volume-99f80a19-53eb-4194-9c6a-e325d9fef8c7 (99f80a19-53eb-4194-9c6a-e325d9fef8c7): created successfully Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea533884-6a1c-4f57-81fc-8b3f3f4d5106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Flow 'volume_create_manager' (19eeb676-ed74-4617-9acb-6ea043da35f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:06 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a71d1cb5-fc61-4540-9053-8dcacc353a48 tempest-ServersNegativeTestJSON-340790296 None] Created volume successfully. Sep 28 17:08:07 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.7f5c5adb-47fe-44da-8cbf-fa516f5e413a" returned: 0 in 0.604s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:08:07 devstack sudo[92272]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.388s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:08:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 8 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:08:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:08:07 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc525b5c-09b0-4871-89fb-26016ea356aa]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:07 devstack sudo[92280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a Sep 28 17:08:07 devstack sudo[92280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:07 devstack sudo[92280]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-30ba40a4-7e5c-4a89-9b1d-2db639cfca6e tempest-ServersNegativeTestJSON-340790296 None] Acquiring lock "cinder-99f80a19-53eb-4194-9c6a-e325d9fef8c7-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a" returned: 0 in 0.484s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.7f5c5adb-47fe-44da-8cbf-fa516f5e413a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-30ba40a4-7e5c-4a89-9b1d-2db639cfca6e tempest-ServersNegativeTestJSON-340790296 None] Lock "cinder-99f80a19-53eb-4194-9c6a-e325d9fef8c7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:07 devstack sudo[92285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.7f5c5adb-47fe-44da-8cbf-fa516f5e413a Sep 28 17:08:07 devstack sudo[92285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-30ba40a4-7e5c-4a89-9b1d-2db639cfca6e tempest-ServersNegativeTestJSON-340790296 None] Acquiring lock "cinder-quobyte-99f80a19-53eb-4194-9c6a-e325d9fef8c7" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-30ba40a4-7e5c-4a89-9b1d-2db639cfca6e tempest-ServersNegativeTestJSON-340790296 None] Lock "cinder-quobyte-99f80a19-53eb-4194-9c6a-e325d9fef8c7" acquired by "delete_volume" :: waited 0.015s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:07 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e0e9b6-cdb0-4a00-90f3-d911e8c204f5]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-30ba40a4-7e5c-4a89-9b1d-2db639cfca6e tempest-ServersNegativeTestJSON-340790296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-99f80a19-53eb-4194-9c6a-e325d9fef8c7 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:07 devstack sudo[92287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-99f80a19-53eb-4194-9c6a-e325d9fef8c7 Sep 28 17:08:07 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:08 devstack sudo[92285]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.7f5c5adb-47fe-44da-8cbf-fa516f5e413a" returned: 0 in 0.450s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.7f5c5adb-47fe-44da-8cbf-fa516f5e413a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:08 devstack sudo[92292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.7f5c5adb-47fe-44da-8cbf-fa516f5e413a Sep 28 17:08:08 devstack sudo[92292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:08 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-30ba40a4-7e5c-4a89-9b1d-2db639cfca6e tempest-ServersNegativeTestJSON-340790296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-99f80a19-53eb-4194-9c6a-e325d9fef8c7" returned: 0 in 0.521s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-30ba40a4-7e5c-4a89-9b1d-2db639cfca6e tempest-ServersNegativeTestJSON-340790296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-99f80a19-53eb-4194-9c6a-e325d9fef8c7 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:08 devstack sudo[92297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-99f80a19-53eb-4194-9c6a-e325d9fef8c7 Sep 28 17:08:08 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:08 devstack sudo[92292]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a.7f5c5adb-47fe-44da-8cbf-fa516f5e413a" returned: 0 in 0.316s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-7f5c5adb-47fe-44da-8cbf-fa516f5e413a" released by "_delete_snapshot" :: held 2.044s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-9698d9c4-e394-4986-8d62-4ccfbbe32a7a" released by "delete_snapshot" :: held 2.079s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "cinder-quobyte-75085f66-15bc-428d-baf1-7d467a35e7a4" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-75085f66-15bc-428d-baf1-7d467a35e7a4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "cinder-quobyte-80938f0e-6897-4034-9d80-281086d0b5ba" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-80938f0e-6897-4034-9d80-281086d0b5ba" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Deleting offline snapshot 80938f0e-6897-4034-9d80-281086d0b5ba of volume 75085f66-15bc-428d-baf1-7d467a35e7a4 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] snapshot_file for this snap is: volume-75085f66-15bc-428d-baf1-7d467a35e7a4.80938f0e-6897-4034-9d80-281086d0b5ba {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f57f36c-e702-45a2-aabe-0986c47f38d0]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.80938f0e-6897-4034-9d80-281086d0b5ba {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:08 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-30ba40a4-7e5c-4a89-9b1d-2db639cfca6e tempest-ServersNegativeTestJSON-340790296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-99f80a19-53eb-4194-9c6a-e325d9fef8c7" returned: 0 in 0.339s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-30ba40a4-7e5c-4a89-9b1d-2db639cfca6e tempest-ServersNegativeTestJSON-340790296 None] Lock "cinder-quobyte-99f80a19-53eb-4194-9c6a-e325d9fef8c7" released by "delete_volume" :: held 0.929s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:08 devstack sudo[92300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.80938f0e-6897-4034-9d80-281086d0b5ba Sep 28 17:08:08 devstack sudo[92300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-30ba40a4-7e5c-4a89-9b1d-2db639cfca6e tempest-ServersNegativeTestJSON-340790296 None] Created reservations ['2f548fae-9528-4b9c-800d-de4f27ed99a0', 'e614aa7e-4d8f-400f-8a60-b7596498ad84', '4842b9d7-1d9b-484f-a746-0996da37e883', '8b2242df-bdc8-4a0e-88d9-08317c268be4'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-30ba40a4-7e5c-4a89-9b1d-2db639cfca6e tempest-ServersNegativeTestJSON-340790296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-30ba40a4-7e5c-4a89-9b1d-2db639cfca6e tempest-ServersNegativeTestJSON-340790296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-30ba40a4-7e5c-4a89-9b1d-2db639cfca6e tempest-ServersNegativeTestJSON-340790296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-30ba40a4-7e5c-4a89-9b1d-2db639cfca6e tempest-ServersNegativeTestJSON-340790296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-30ba40a4-7e5c-4a89-9b1d-2db639cfca6e tempest-ServersNegativeTestJSON-340790296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-30ba40a4-7e5c-4a89-9b1d-2db639cfca6e tempest-ServersNegativeTestJSON-340790296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:08 devstack sudo[92303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:08:08 devstack sudo[92303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:09 devstack sudo[92300]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.80938f0e-6897-4034-9d80-281086d0b5ba" returned: 0 in 0.506s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75085f66-15bc-428d-baf1-7d467a35e7a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:08:09 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71e2d91-8a7d-49d5-b8fb-e1b5bfaaac55]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:09 devstack sudo[92303]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-30ba40a4-7e5c-4a89-9b1d-2db639cfca6e tempest-ServersNegativeTestJSON-340790296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.340s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:09 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-30ba40a4-7e5c-4a89-9b1d-2db639cfca6e tempest-ServersNegativeTestJSON-340790296 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:09 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-30ba40a4-7e5c-4a89-9b1d-2db639cfca6e tempest-ServersNegativeTestJSON-340790296 None] Deleted volume successfully. Sep 28 17:08:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-30ba40a4-7e5c-4a89-9b1d-2db639cfca6e tempest-ServersNegativeTestJSON-340790296 None] Lock "cinder-99f80a19-53eb-4194-9c6a-e325d9fef8c7-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:09 devstack sudo[92308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4 Sep 28 17:08:09 devstack sudo[92308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:09 devstack sudo[92308]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4" returned: 0 in 0.482s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.80938f0e-6897-4034-9d80-281086d0b5ba {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:09 devstack sudo[92315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.80938f0e-6897-4034-9d80-281086d0b5ba Sep 28 17:08:09 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-71f6e6f6-a1bb-4072-b49f-15899113ecfd tempest-ServersNegativeTestJSON-340790296 None] Acquiring lock "cinder-4f4cbc96-0758-447f-bb6a-7d5dcf4541d2-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-71f6e6f6-a1bb-4072-b49f-15899113ecfd tempest-ServersNegativeTestJSON-340790296 None] Lock "cinder-4f4cbc96-0758-447f-bb6a-7d5dcf4541d2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-71f6e6f6-a1bb-4072-b49f-15899113ecfd tempest-ServersNegativeTestJSON-340790296 None] Acquiring lock "cinder-quobyte-4f4cbc96-0758-447f-bb6a-7d5dcf4541d2" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-71f6e6f6-a1bb-4072-b49f-15899113ecfd tempest-ServersNegativeTestJSON-340790296 None] Lock "cinder-quobyte-4f4cbc96-0758-447f-bb6a-7d5dcf4541d2" acquired by "delete_volume" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:10 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.80938f0e-6897-4034-9d80-281086d0b5ba" returned: 0 in 0.476s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.80938f0e-6897-4034-9d80-281086d0b5ba {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:10 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9802f90a-9d89-478d-9021-4908e5096342]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-71f6e6f6-a1bb-4072-b49f-15899113ecfd tempest-ServersNegativeTestJSON-340790296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4f4cbc96-0758-447f-bb6a-7d5dcf4541d2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:10 devstack sudo[92320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.80938f0e-6897-4034-9d80-281086d0b5ba Sep 28 17:08:10 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:10 devstack sudo[92322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4f4cbc96-0758-447f-bb6a-7d5dcf4541d2 Sep 28 17:08:10 devstack sudo[92322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:10 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4.80938f0e-6897-4034-9d80-281086d0b5ba" returned: 0 in 0.300s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-80938f0e-6897-4034-9d80-281086d0b5ba" released by "_delete_snapshot" :: held 1.917s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-75085f66-15bc-428d-baf1-7d467a35e7a4" released by "delete_snapshot" :: held 1.942s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:10 devstack cinder-volume[87061]: WARNING cinder.quota [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1507482752 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1507482752, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:08:10 devstack cinder-volume[87061]: WARNING cinder.quota [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1507482752 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1507482752, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:08:10 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Created reservations ['98b3c05f-be5d-46fe-9300-bb86c7f74c85', '0aeb392a-0143-4a92-823a-59bcfa1cc2eb', '65242eda-5261-49b9-8dd6-662aff8ab018', '4434a32a-d2a1-46de-b1cf-d60965d0cef4'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:10 devstack sudo[92322]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-71f6e6f6-a1bb-4072-b49f-15899113ecfd tempest-ServersNegativeTestJSON-340790296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4f4cbc96-0758-447f-bb6a-7d5dcf4541d2" returned: 0 in 0.483s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-71f6e6f6-a1bb-4072-b49f-15899113ecfd tempest-ServersNegativeTestJSON-340790296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4f4cbc96-0758-447f-bb6a-7d5dcf4541d2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:10 devstack sudo[92328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4f4cbc96-0758-447f-bb6a-7d5dcf4541d2 Sep 28 17:08:10 devstack sudo[92328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:10 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] Created reservations ['590e5f27-4052-4d68-865c-204eaed0c6ac', '5aa602f0-3ff1-49bf-acae-33fc458fbda3', '823bc868-21e8-409d-a330-d623bba05675', 'edd7218c-7256-4aaa-abec-8ed9a50f61ab'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:10 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-ff3e9ede-7f71-4882-adf6-b18adac95379 tempest-GroupSnapshotsTest-1785720431 None] group_snapshot 6f9c66a1-6a7e-4ec4-b0a8-2b31ae07edd1: deleted successfully Sep 28 17:08:10 devstack sudo[92328]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-71f6e6f6-a1bb-4072-b49f-15899113ecfd tempest-ServersNegativeTestJSON-340790296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4f4cbc96-0758-447f-bb6a-7d5dcf4541d2" returned: 0 in 0.327s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-71f6e6f6-a1bb-4072-b49f-15899113ecfd tempest-ServersNegativeTestJSON-340790296 None] Lock "cinder-quobyte-4f4cbc96-0758-447f-bb6a-7d5dcf4541d2" released by "delete_volume" :: held 0.887s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:11 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-71f6e6f6-a1bb-4072-b49f-15899113ecfd tempest-ServersNegativeTestJSON-340790296 None] Created reservations ['9ea27bb8-f9a5-44d8-a1ac-5073f1ac5981', '18c950de-608e-47b0-b16d-c640142301c9', '958ad64f-e1d4-4036-85a9-a2a82525b1fd', '49e6091c-9f62-49ab-9966-61bd7d840f77'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-71f6e6f6-a1bb-4072-b49f-15899113ecfd tempest-ServersNegativeTestJSON-340790296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-71f6e6f6-a1bb-4072-b49f-15899113ecfd tempest-ServersNegativeTestJSON-340790296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-71f6e6f6-a1bb-4072-b49f-15899113ecfd tempest-ServersNegativeTestJSON-340790296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-71f6e6f6-a1bb-4072-b49f-15899113ecfd tempest-ServersNegativeTestJSON-340790296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-71f6e6f6-a1bb-4072-b49f-15899113ecfd tempest-ServersNegativeTestJSON-340790296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-71f6e6f6-a1bb-4072-b49f-15899113ecfd tempest-ServersNegativeTestJSON-340790296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:11 devstack sudo[92331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:08:11 devstack sudo[92331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:11 devstack sudo[92331]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-71f6e6f6-a1bb-4072-b49f-15899113ecfd tempest-ServersNegativeTestJSON-340790296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.365s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:11 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-71f6e6f6-a1bb-4072-b49f-15899113ecfd tempest-ServersNegativeTestJSON-340790296 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:11 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-71f6e6f6-a1bb-4072-b49f-15899113ecfd tempest-ServersNegativeTestJSON-340790296 None] Deleted volume successfully. Sep 28 17:08:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-71f6e6f6-a1bb-4072-b49f-15899113ecfd tempest-ServersNegativeTestJSON-340790296 None] Lock "cinder-4f4cbc96-0758-447f-bb6a-7d5dcf4541d2-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "cinder-quobyte-75085f66-15bc-428d-baf1-7d467a35e7a4" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-75085f66-15bc-428d-baf1-7d467a35e7a4" acquired by "delete_volume" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:11 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbfaec9-db36-40dc-98d6-e37ff183ed7d]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:11 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4 Sep 28 17:08:11 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:12 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4" returned: 0 in 0.637s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:12 devstack sudo[92364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4 Sep 28 17:08:12 devstack sudo[92364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:12 devstack sudo[92364]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-75085f66-15bc-428d-baf1-7d467a35e7a4" returned: 0 in 0.371s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-75085f66-15bc-428d-baf1-7d467a35e7a4" released by "delete_volume" :: held 1.122s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "cinder-quobyte-9698d9c4-e394-4986-8d62-4ccfbbe32a7a" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-9698d9c4-e394-4986-8d62-4ccfbbe32a7a" acquired by "delete_volume" :: waited 0.026s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:12 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c77fb8-dca1-438a-b929-02243aceefad]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:13 devstack sudo[92375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a Sep 28 17:08:13 devstack sudo[92375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:13 devstack sudo[92375]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a" returned: 0 in 0.614s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:13 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a Sep 28 17:08:13 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:13 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9698d9c4-e394-4986-8d62-4ccfbbe32a7a" returned: 0 in 0.376s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-9698d9c4-e394-4986-8d62-4ccfbbe32a7a" released by "delete_volume" :: held 1.116s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:14 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] Created reservations ['4abd2356-fb5d-4333-ace7-f6df2618fd9b'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:14 devstack cinder-volume[87061]: WARNING cinder.quota [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1507482752 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1507482752, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:08:14 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] Created reservations ['50ca6c00-a8bd-4a57-b733-fc105e310363', 'd415b27e-7a09-4cb3-bcf5-132cfab02bd0', '9636099a-df85-4323-92d1-71a8c582ef9d', 'c45735ed-e2ff-47f4-a06c-2997deb7b3ce'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:14 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] Created reservations ['6f27ce7b-e0bc-4776-ac5a-329584df4f6d', '3b02ed59-e1af-4b80-b181-7857b0d820dd', '9669319b-c2ff-49a1-b141-c03d04eba56c', '545b9122-fe1e-4537-aff3-bacbae74430c'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:14 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:14 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:14 devstack sudo[92393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:08:14 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:15 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.376s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:15 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:15 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-667c9c3a-a356-4afc-a27c-66b3b5424a7a tempest-GroupSnapshotsTest-1785720431 None] Delete group completed successfully. Sep 28 17:08:15 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-859ea202-5a0f-43d5-95bd-aa098895dc55 req-191abdb7-6149-4b3f-bd70-1c8616b9cc76 tempest-ServerActionsTestOtherA-1604287769 None] Terminate volume connection completed successfully. Sep 28 17:08:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-859ea202-5a0f-43d5-95bd-aa098895dc55 req-191abdb7-6149-4b3f-bd70-1c8616b9cc76 tempest-ServerActionsTestOtherA-1604287769 None] Deleting attachment 482b6af5-44a0-4de3-85c1-5219e427ae0f. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:08:16 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d98a7e35-3f72-48a4-ac8e-30d61c9b8c9f tempest-GroupSnapshotsTest-1785720431 None] Group tempest-GroupSnapshotsTest-Group-1795689756: creating Sep 28 17:08:16 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d98a7e35-3f72-48a4-ac8e-30d61c9b8c9f tempest-GroupSnapshotsTest-1785720431 None] Group tempest-GroupSnapshotsTest-Group-1795689756: created successfully Sep 28 17:08:16 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d98a7e35-3f72-48a4-ac8e-30d61c9b8c9f tempest-GroupSnapshotsTest-1785720431 None] Create group completed successfully. Sep 28 17:08:18 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Flow 'volume_create_manager' (9a7932f5-dbad-42f8-a026-b04eebedea73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3d2dd2-999f-4c67-80ed-327d931a9e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3d2dd2-999f-4c67-80ed-327d931a9e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-199781214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d381f86-7b4e-4e9b-beb3-62979c16b70a,host='devstack@QuobyteHD#QuobyteHD',id=e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81011936a31245df945eae30600680ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:18Z,use_quota=True,user_id='0ca9f9caaf864ad7be8e51c6f40f7045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66c227ed-7d23-40af-8305-c8c856a49ee3),volume_type_id=66c227ed-7d23-40af-8305-c8c856a49ee3)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895318f6-946c-4d83-9d9e-9ef33469d914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895318f6-946c-4d83-9d9e-9ef33469d914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a67fcc-1bf8-4fa7-8f67-7c6a4b90fc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a67fcc-1bf8-4fa7-8f67-7c6a4b90fc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6', 'volume_name': 'volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310615dd-4f43-4255-a71f-b2fe649d89a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310615dd-4f43-4255-a71f-b2fe649d89a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e8f4e75-c080-4a7f-8855-67e478d00fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:18 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Volume e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6', 'volume_size': 1} Sep 28 17:08:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:18 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5d381f86-7b4e-4e9b-beb3-62979c16b70a,created_at=2026-09-28T15:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-199781214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d381f86-7b4e-4e9b-beb3-62979c16b70a,host='devstack@QuobyteHD#QuobyteHD',id=e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81011936a31245df945eae30600680ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:18Z,use_quota=True,user_id='0ca9f9caaf864ad7be8e51c6f40f7045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66c227ed-7d23-40af-8305-c8c856a49ee3),volume_type_id=66c227ed-7d23-40af-8305-c8c856a49ee3)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:18 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Creating volume e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:18 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:18 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:18 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:18 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:08:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:18 devstack sudo[92455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6 1073741824 Sep 28 17:08:18 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:19 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6 1073741824" returned: 0 in 0.688s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:19 devstack sudo[92464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6 Sep 28 17:08:19 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:19 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6" returned: 0 in 0.339s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e8f4e75-c080-4a7f-8855-67e478d00fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1905995-5a21-46b5-95f4-65801c308430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:19 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Volume volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6 (e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6): created successfully Sep 28 17:08:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1905995-5a21-46b5-95f4-65801c308430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Flow 'volume_create_manager' (9a7932f5-dbad-42f8-a026-b04eebedea73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:19 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a7747d76-9687-476f-a414-c4f94242db9b tempest-GroupSnapshotsTest-1785720431 None] Created volume successfully. Sep 28 17:08:21 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e5922125-6832-43f2-b61d-67e930203957 tempest-GroupSnapshotsTest-1785720431 None] GroupSnapshot 693ef07a-e29f-4556-baca-85c27cab3fa9: creating. Sep 28 17:08:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e5922125-6832-43f2-b61d-67e930203957 tempest-GroupSnapshotsTest-1785720431 None] Group snapshot 693ef07a-e29f-4556-baca-85c27cab3fa9: creating. {{(pid=87061) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:08:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e5922125-6832-43f2-b61d-67e930203957 tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e5922125-6832-43f2-b61d-67e930203957 tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:21 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-e5922125-6832-43f2-b61d-67e930203957 tempest-GroupSnapshotsTest-1785720431 None] Creating offline snapshot 2c1a01e9-ecbe-406d-9785-94c68ccb4289 of volume e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:08:21 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[238e5996-c6fd-40b2-9fbf-0e53c9bce47b]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e5922125-6832-43f2-b61d-67e930203957 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:21 devstack sudo[92471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6 Sep 28 17:08:21 devstack sudo[92471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:22 devstack sudo[92471]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e5922125-6832-43f2-b61d-67e930203957 tempest-GroupSnapshotsTest-1785720431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6" returned: 0 in 0.682s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e5922125-6832-43f2-b61d-67e930203957 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.2c1a01e9-ecbe-406d-9785-94c68ccb4289 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:22 devstack sudo[92476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.2c1a01e9-ecbe-406d-9785-94c68ccb4289 1G Sep 28 17:08:22 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:22 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e5922125-6832-43f2-b61d-67e930203957 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.2c1a01e9-ecbe-406d-9785-94c68ccb4289 1G" returned: 0 in 0.563s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e5922125-6832-43f2-b61d-67e930203957 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.2c1a01e9-ecbe-406d-9785-94c68ccb4289 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:22 devstack sudo[92483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.2c1a01e9-ecbe-406d-9785-94c68ccb4289 Sep 28 17:08:22 devstack sudo[92483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:23 devstack sudo[92483]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e5922125-6832-43f2-b61d-67e930203957 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.2c1a01e9-ecbe-406d-9785-94c68ccb4289" returned: 0 in 0.567s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:23 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-e5922125-6832-43f2-b61d-67e930203957 tempest-GroupSnapshotsTest-1785720431 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.2c1a01e9-ecbe-406d-9785-94c68ccb4289 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:08:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e5922125-6832-43f2-b61d-67e930203957 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.2c1a01e9-ecbe-406d-9785-94c68ccb4289 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:23 devstack sudo[92489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.2c1a01e9-ecbe-406d-9785-94c68ccb4289 Sep 28 17:08:23 devstack sudo[92489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:23 devstack sudo[92489]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e5922125-6832-43f2-b61d-67e930203957 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.2c1a01e9-ecbe-406d-9785-94c68ccb4289" returned: 0 in 0.396s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:23 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=94,cinder:INSERT=22,cinder:UPDATE=95,cinder:DELETE=5 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:08:23 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:UPDATE=110,cinder:SELECT=105,cinder:INSERT=25,cinder:DELETE=2 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:08:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e5922125-6832-43f2-b61d-67e930203957 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:23 devstack sudo[92492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.info Sep 28 17:08:23 devstack sudo[92492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:24 devstack sudo[92492]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e5922125-6832-43f2-b61d-67e930203957 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.info" returned: 0 in 0.431s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:24 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-e5922125-6832-43f2-b61d-67e930203957 tempest-GroupSnapshotsTest-1785720431 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:08:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e5922125-6832-43f2-b61d-67e930203957 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:24 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.info Sep 28 17:08:24 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c8cdf310-7cd8-472a-98dd-81c63e0f0eec tempest-AttachVolumeShelveTestJSON-1974916074 None] Acquiring lock "cinder-e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c8cdf310-7cd8-472a-98dd-81c63e0f0eec tempest-AttachVolumeShelveTestJSON-1974916074 None] Lock "cinder-e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c8cdf310-7cd8-472a-98dd-81c63e0f0eec tempest-AttachVolumeShelveTestJSON-1974916074 None] Acquiring lock "cinder-quobyte-e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c8cdf310-7cd8-472a-98dd-81c63e0f0eec tempest-AttachVolumeShelveTestJSON-1974916074 None] Lock "cinder-quobyte-e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6" acquired by "delete_volume" :: waited 0.021s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:24 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e5922125-6832-43f2-b61d-67e930203957 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.info" returned: 0 in 0.511s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e5922125-6832-43f2-b61d-67e930203957 tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.306s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:24 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[7671fe2d-45af-474c-879a-fb5079fbaf56]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c8cdf310-7cd8-472a-98dd-81c63e0f0eec tempest-AttachVolumeShelveTestJSON-1974916074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:25 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e5922125-6832-43f2-b61d-67e930203957 tempest-GroupSnapshotsTest-1785720431 None] group_snapshot 693ef07a-e29f-4556-baca-85c27cab3fa9: created successfully Sep 28 17:08:25 devstack sudo[92499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6 Sep 28 17:08:25 devstack sudo[92499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:25 devstack sudo[92499]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c8cdf310-7cd8-472a-98dd-81c63e0f0eec tempest-AttachVolumeShelveTestJSON-1974916074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6" returned: 0 in 0.536s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c8cdf310-7cd8-472a-98dd-81c63e0f0eec tempest-AttachVolumeShelveTestJSON-1974916074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:25 devstack sudo[92505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6 Sep 28 17:08:25 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:25 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Flow 'volume_create_manager' (c0d4a17a-54c7-416e-8d2c-ac6b2c4fc94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a6f921-00f8-4a9a-b1cf-d2c71de335f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:25 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a6f921-00f8-4a9a-b1cf-d2c71de335f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-716436389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c981ed4b-50f5-4504-b660-ed282a7ffe11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c671d5959de4f69af3dece762c5a45e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:26Z,use_quota=True,user_id='d8113dfd66cb4066bed7f21d04697e0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6838cd8e-d3cb-429e-8530-dad43bad9560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6838cd8e-d3cb-429e-8530-dad43bad9560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f65e543-d3db-4086-9040-9e793b21e2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:25 devstack cinder-volume[87061]: DEBUG cinder.image.glance [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Creating Keystone auth plugin from conf {{(pid=87061) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:08:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c8cdf310-7cd8-472a-98dd-81c63e0f0eec tempest-AttachVolumeShelveTestJSON-1974916074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6" returned: 0 in 0.358s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:25 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c8cdf310-7cd8-472a-98dd-81c63e0f0eec tempest-AttachVolumeShelveTestJSON-1974916074 None] Lock "cinder-quobyte-e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6" released by "delete_volume" :: held 1.008s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:25 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-c8cdf310-7cd8-472a-98dd-81c63e0f0eec tempest-AttachVolumeShelveTestJSON-1974916074 None] Created reservations ['8bc0ff40-087d-4a51-88f1-24e34feafe76', 'd61632e6-df78-4725-9d92-7b38ff2ed31a', '645b1d29-732c-400d-8eb8-f32ab3d6da26', '0f2b709b-e825-47f0-b40a-25c73144a780'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c8cdf310-7cd8-472a-98dd-81c63e0f0eec tempest-AttachVolumeShelveTestJSON-1974916074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c8cdf310-7cd8-472a-98dd-81c63e0f0eec tempest-AttachVolumeShelveTestJSON-1974916074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c8cdf310-7cd8-472a-98dd-81c63e0f0eec tempest-AttachVolumeShelveTestJSON-1974916074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c8cdf310-7cd8-472a-98dd-81c63e0f0eec tempest-AttachVolumeShelveTestJSON-1974916074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c8cdf310-7cd8-472a-98dd-81c63e0f0eec tempest-AttachVolumeShelveTestJSON-1974916074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c8cdf310-7cd8-472a-98dd-81c63e0f0eec tempest-AttachVolumeShelveTestJSON-1974916074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:26 devstack sudo[92508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:08:26 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:26 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] group_snapshot 693ef07a-e29f-4556-baca-85c27cab3fa9: deleting Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] group_snapshot 693ef07a-e29f-4556-baca-85c27cab3fa9: deleting {{(pid=87061) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "cinder-quobyte-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "cinder-quobyte-2c1a01e9-ecbe-406d-9785-94c68ccb4289" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-2c1a01e9-ecbe-406d-9785-94c68ccb4289" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] Deleting offline snapshot 2c1a01e9-ecbe-406d-9785-94c68ccb4289 of volume e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] snapshot_file for this snap is: volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.2c1a01e9-ecbe-406d-9785-94c68ccb4289 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f3f786-1bd8-498d-b096-d047edfaf0bc]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.2c1a01e9-ecbe-406d-9785-94c68ccb4289 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:26 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c8cdf310-7cd8-472a-98dd-81c63e0f0eec tempest-AttachVolumeShelveTestJSON-1974916074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.495s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-c8cdf310-7cd8-472a-98dd-81c63e0f0eec tempest-AttachVolumeShelveTestJSON-1974916074 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:26 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-c8cdf310-7cd8-472a-98dd-81c63e0f0eec tempest-AttachVolumeShelveTestJSON-1974916074 None] Deleted volume successfully. Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c8cdf310-7cd8-472a-98dd-81c63e0f0eec tempest-AttachVolumeShelveTestJSON-1974916074 None] Lock "cinder-e5e0051b-80ba-4bf7-9f22-bd24f6b54ef6-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:26 devstack sudo[92511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.2c1a01e9-ecbe-406d-9785-94c68ccb4289 Sep 28 17:08:26 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f65e543-d3db-4086-9040-9e793b21e2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c981ed4b-50f5-4504-b660-ed282a7ffe11', 'volume_name': 'volume-c981ed4b-50f5-4504-b660-ed282a7ffe11', 'volume_size': 1, 'image_id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21d27c6a4ac749c0a5b3cbd558b3b102', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'created_at': datetime.datetime(2026, 9, 28, 14, 57, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3da6edc3-4055-4154-be43-a897ff97d7cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8471a0fa-ac43-4b6c-a91e-6e76cbdc36d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8471a0fa-ac43-4b6c-a91e-6e76cbdc36d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab4c742c-b5de-4f00-91f5-c6ea4844b579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:26 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Volume c981ed4b-50f5-4504-b660-ed282a7ffe11: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c981ed4b-50f5-4504-b660-ed282a7ffe11', 'volume_size': 1, 'image_id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21d27c6a4ac749c0a5b3cbd558b3b102', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'created_at': datetime.datetime(2026, 9, 28, 14, 57, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3da6edc3-4055-4154-be43-a897ff97d7cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:08:26 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Trying to clone c981ed4b-50f5-4504-b660-ed282a7ffe11 from image 3da6edc3-4055-4154-be43-a897ff97d7cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}]). {{(pid=87061) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:08:27 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.2c1a01e9-ecbe-406d-9785-94c68ccb4289" returned: 0 in 0.667s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:27 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:08:27 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ca6503-63ff-4c90-ad01-c40b9dd1111a]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:27 devstack sudo[92536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6 Sep 28 17:08:27 devstack sudo[92536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:27 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_4nnlftyydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:08:27 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:08:27 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b12191-8bca-4919-bd98-4deefd43b1ee]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_4nnlftyydevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:27 devstack sudo[92539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_4nnlftyydevstack@QuobyteHD Sep 28 17:08:27 devstack sudo[92539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:27 devstack sudo[92536]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6" returned: 0 in 0.688s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.2c1a01e9-ecbe-406d-9785-94c68ccb4289 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:28 devstack sudo[92545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.2c1a01e9-ecbe-406d-9785-94c68ccb4289 Sep 28 17:08:28 devstack sudo[92545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:28 devstack sudo[92539]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_4nnlftyydevstack@QuobyteHD" returned: 0 in 0.551s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:28 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Temporary image 3da6edc3-4055-4154-be43-a897ff97d7cf is fetched for user d8113dfd66cb4066bed7f21d04697e0c. {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:08:28 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[655e6fc3-6807-4b28-9f2f-4c693c3061af]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_4nnlftyydevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:28 devstack sudo[92550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_4nnlftyydevstack@QuobyteHD Sep 28 17:08:28 devstack sudo[92550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:28 devstack sudo[92545]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.2c1a01e9-ecbe-406d-9785-94c68ccb4289" returned: 0 in 0.569s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.2c1a01e9-ecbe-406d-9785-94c68ccb4289 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:28 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.2c1a01e9-ecbe-406d-9785-94c68ccb4289 Sep 28 17:08:28 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:28 devstack sudo[92550]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_4nnlftyydevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-716436389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c981ed4b-50f5-4504-b660-ed282a7ffe11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c671d5959de4f69af3dece762c5a45e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:26Z,use_quota=True,user_id='d8113dfd66cb4066bed7f21d04697e0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Creating volume c981ed4b-50f5-4504-b660-ed282a7ffe11 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:28 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:08:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c981ed4b-50f5-4504-b660-ed282a7ffe11 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:28 devstack sudo[92561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c981ed4b-50f5-4504-b660-ed282a7ffe11 1073741824 Sep 28 17:08:28 devstack sudo[92561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:28 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6.2c1a01e9-ecbe-406d-9785-94c68ccb4289" returned: 0 in 0.405s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-2c1a01e9-ecbe-406d-9785-94c68ccb4289" released by "_delete_snapshot" :: held 2.541s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6" released by "delete_snapshot" :: held 2.573s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:29 devstack cinder-volume[87061]: WARNING cinder.quota [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1758421684 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1758421684, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:08:29 devstack cinder-volume[87061]: WARNING cinder.quota [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1758421684 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1758421684, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:08:29 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] Created reservations ['9d3108ae-eb16-452a-a6e4-3d4d67291d9f', 'cc4c2d75-eff8-4a6e-a84b-40029f2ece12', '0aef65c9-5b76-471d-8fa8-8808050006e6', 'a312a937-d467-4af4-9932-9c6ac9f1e0b5'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:29 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-3fe2938f-d76b-4090-95ac-a16b98eeefdf tempest-GroupSnapshotsTest-1785720431 None] group_snapshot 693ef07a-e29f-4556-baca-85c27cab3fa9: deleted successfully Sep 28 17:08:29 devstack sudo[92561]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c981ed4b-50f5-4504-b660-ed282a7ffe11 1073741824" returned: 0 in 0.690s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c981ed4b-50f5-4504-b660-ed282a7ffe11 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:29 devstack sudo[92568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c981ed4b-50f5-4504-b660-ed282a7ffe11 Sep 28 17:08:29 devstack sudo[92568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:29 devstack sudo[92568]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c981ed4b-50f5-4504-b660-ed282a7ffe11" returned: 0 in 0.355s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:29 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Attempting download of 3da6edc3-4055-4154-be43-a897ff97d7cf ((None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}])) to volume c981ed4b-50f5-4504-b660-ed282a7ffe11. {{(pid=87061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:08:30 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a246266-8ba4-423c-b152-9bdf51688c09]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_0x_7zgjg {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:30 devstack sudo[92572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_0x_7zgjg Sep 28 17:08:30 devstack sudo[92572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-74d197e8-cece-4d16-97c1-2fba61b243f0 tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "cinder-quobyte-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-74d197e8-cece-4d16-97c1-2fba61b243f0 tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6" acquired by "delete_volume" :: waited 0.033s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:30 devstack sudo[92572]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_0x_7zgjg" returned: 0 in 0.562s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_0x_7zgjg {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:30 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d02b157-8574-48f3-b625-7fa2be7372e6]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-74d197e8-cece-4d16-97c1-2fba61b243f0 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:30 devstack sudo[92576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_0x_7zgjg Sep 28 17:08:30 devstack sudo[92576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:30 devstack sudo[92577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6 Sep 28 17:08:30 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:31 devstack sudo[92576]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_0x_7zgjg" returned: 1 in 0.485s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_0x_7zgjg' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:08:31 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[3464082d-789b-4f1d-8a83-85623f5a5db1]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_4nnlftyydevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:31 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-74d197e8-cece-4d16-97c1-2fba61b243f0 tempest-GroupSnapshotsTest-1785720431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6" returned: 0 in 0.603s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-74d197e8-cece-4d16-97c1-2fba61b243f0 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:31 devstack sudo[92584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_4nnlftyydevstack@QuobyteHD Sep 28 17:08:31 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6 Sep 28 17:08:31 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:31 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:31 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:31 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_4nnlftyydevstack@QuobyteHD" returned: 0 in 0.605s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-74d197e8-cece-4d16-97c1-2fba61b243f0 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6" returned: 0 in 0.466s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:31 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] 3da6edc3-4055-4154-be43-a897ff97d7cf was qcow2, converting to qcow2 {{(pid=87061) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:08:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_4nnlftyydevstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c981ed4b-50f5-4504-b660-ed282a7ffe11 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:31 devstack sudo[92593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_4nnlftyydevstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c981ed4b-50f5-4504-b660-ed282a7ffe11 Sep 28 17:08:31 devstack sudo[92593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-74d197e8-cece-4d16-97c1-2fba61b243f0 tempest-GroupSnapshotsTest-1785720431 None] Lock "cinder-quobyte-e25288fb-f2f6-4eb6-b01f-775aa6ef9dc6" released by "delete_volume" :: held 1.220s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:31 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-74d197e8-cece-4d16-97c1-2fba61b243f0 tempest-GroupSnapshotsTest-1785720431 None] Created reservations ['1be27c7b-5362-41ba-bffe-18f893f993ab'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:31 devstack cinder-volume[87061]: WARNING cinder.quota [None req-74d197e8-cece-4d16-97c1-2fba61b243f0 tempest-GroupSnapshotsTest-1785720431 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1758421684 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1758421684, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:08:31 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-74d197e8-cece-4d16-97c1-2fba61b243f0 tempest-GroupSnapshotsTest-1785720431 None] Created reservations ['54e2abf8-e568-4ba2-a3e2-b12a45a1c2a0', 'a9b43586-ba44-407b-8d31-63778a8aef68', '60dba665-340c-43a4-8315-4fc83ad92d55', 'a2f799e4-991d-4be1-a11f-06f9854589da'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-74d197e8-cece-4d16-97c1-2fba61b243f0 tempest-GroupSnapshotsTest-1785720431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-74d197e8-cece-4d16-97c1-2fba61b243f0 tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-74d197e8-cece-4d16-97c1-2fba61b243f0 tempest-GroupSnapshotsTest-1785720431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-74d197e8-cece-4d16-97c1-2fba61b243f0 tempest-GroupSnapshotsTest-1785720431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-74d197e8-cece-4d16-97c1-2fba61b243f0 tempest-GroupSnapshotsTest-1785720431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-74d197e8-cece-4d16-97c1-2fba61b243f0 tempest-GroupSnapshotsTest-1785720431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:32 devstack sudo[92599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:08:32 devstack sudo[92599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:32 devstack sudo[92599]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-74d197e8-cece-4d16-97c1-2fba61b243f0 tempest-GroupSnapshotsTest-1785720431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.421s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:32 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-74d197e8-cece-4d16-97c1-2fba61b243f0 tempest-GroupSnapshotsTest-1785720431 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:32 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-74d197e8-cece-4d16-97c1-2fba61b243f0 tempest-GroupSnapshotsTest-1785720431 None] Delete group completed successfully. Sep 28 17:08:34 devstack sudo[92593]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_4nnlftyydevstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c981ed4b-50f5-4504-b660-ed282a7ffe11" returned: 0 in 3.182s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:34 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_4nnlftyydevstack@QuobyteHD, size 112.00 MB, duration 3.18 sec, destination /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c981ed4b-50f5-4504-b660-ed282a7ffe11 {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:08:34 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Converted 112.00 MB image at 35.18 MB/s Sep 28 17:08:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c981ed4b-50f5-4504-b660-ed282a7ffe11 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:34 devstack sudo[92605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c981ed4b-50f5-4504-b660-ed282a7ffe11 1G Sep 28 17:08:34 devstack sudo[92605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:35 devstack sudo[92605]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c981ed4b-50f5-4504-b660-ed282a7ffe11 1G" returned: 0 in 0.460s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:35 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Downloaded image 3da6edc3-4055-4154-be43-a897ff97d7cf ((None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}])) to volume c981ed4b-50f5-4504-b660-ed282a7ffe11 successfully. {{(pid=87061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:08:35 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Temporary image 3da6edc3-4055-4154-be43-a897ff97d7cf for user d8113dfd66cb4066bed7f21d04697e0c is deleted. {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:08:35 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Marking volume c981ed4b-50f5-4504-b660-ed282a7ffe11 as bootable. {{(pid=87061) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:08:35 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Copying metadata from image 3da6edc3-4055-4154-be43-a897ff97d7cf to c981ed4b-50f5-4504-b660-ed282a7ffe11. {{(pid=87061) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:08:35 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Creating volume glance metadata for volume c981ed4b-50f5-4504-b660-ed282a7ffe11 backed by image 3da6edc3-4055-4154-be43-a897ff97d7cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87061) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:08:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab4c742c-b5de-4f00-91f5-c6ea4844b579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c981ed4b-50f5-4504-b660-ed282a7ffe11', 'volume_size': 1, 'image_id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21d27c6a4ac749c0a5b3cbd558b3b102', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'created_at': datetime.datetime(2026, 9, 28, 14, 57, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3da6edc3-4055-4154-be43-a897ff97d7cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6d211f-666c-47cb-92ac-bf2d8321234d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:35 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Volume volume-c981ed4b-50f5-4504-b660-ed282a7ffe11 (c981ed4b-50f5-4504-b660-ed282a7ffe11): created successfully Sep 28 17:08:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6d211f-666c-47cb-92ac-bf2d8321234d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Flow 'volume_create_manager' (c0d4a17a-54c7-416e-8d2c-ac6b2c4fc94d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:35 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-b22fb870-95fb-4bf9-b24d-559f816b3ec8 tempest-ServerActionsTestOtherA-1604287769 None] Created volume successfully. Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-79b9dc63-3861-43c3-b257-38a5d619678d req-728ac83f-fd09-4d19-8267-334f967bf938 tempest-ServerActionsTestOtherA-1604287769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-79b9dc63-3861-43c3-b257-38a5d619678d req-728ac83f-fd09-4d19-8267-334f967bf938 tempest-ServerActionsTestOtherA-1604287769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-79b9dc63-3861-43c3-b257-38a5d619678d req-728ac83f-fd09-4d19-8267-334f967bf938 tempest-ServerActionsTestOtherA-1604287769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.055s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Flow 'volume_create_manager' (caa42eb8-7d5b-4b7d-8436-39bf8262022a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a849c1e9-4ef7-4062-b0fb-18443f318c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a849c1e9-4ef7-4062-b0fb-18443f318c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1169046891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aab0985-bb4a-42f9-b06f-ecf6167d0950,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb27bc71d2f5432e948160e51aafa9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:42Z,use_quota=True,user_id='925d89b5a0db4a51967d5c86d8ab607c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03c1d53-62f4-4df4-8846-67c88d609a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03c1d53-62f4-4df4-8846-67c88d609a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028b3e1f-bcda-4e54-ba26-e8a5e3e80da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028b3e1f-bcda-4e54-ba26-e8a5e3e80da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aab0985-bb4a-42f9-b06f-ecf6167d0950', 'volume_name': 'volume-5aab0985-bb4a-42f9-b06f-ecf6167d0950', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825d1a5e-46ad-4e45-be80-178c11fa4dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825d1a5e-46ad-4e45-be80-178c11fa4dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133e7ffd-99da-44b7-91c2-0cde117e4065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:42 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Volume 5aab0985-bb4a-42f9-b06f-ecf6167d0950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aab0985-bb4a-42f9-b06f-ecf6167d0950', 'volume_size': 1} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1169046891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aab0985-bb4a-42f9-b06f-ecf6167d0950,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb27bc71d2f5432e948160e51aafa9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:42Z,use_quota=True,user_id='925d89b5a0db4a51967d5c86d8ab607c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Creating volume 5aab0985-bb4a-42f9-b06f-ecf6167d0950 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:42 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5aab0985-bb4a-42f9-b06f-ecf6167d0950 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-79b9dc63-3861-43c3-b257-38a5d619678d req-728ac83f-fd09-4d19-8267-334f967bf938 tempest-ServerActionsTestOtherA-1604287769 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-c981ed4b-50f5-4504-b660-ed282a7ffe11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '994ece9b-8d95-4cf2-8b44-2a2269379026', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:08:42 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5aab0985-bb4a-42f9-b06f-ecf6167d0950 1073741824 Sep 28 17:08:42 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:42 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-79b9dc63-3861-43c3-b257-38a5d619678d req-728ac83f-fd09-4d19-8267-334f967bf938 tempest-ServerActionsTestOtherA-1604287769 None] attachment_update completed successfully. Sep 28 17:08:43 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5aab0985-bb4a-42f9-b06f-ecf6167d0950 1073741824" returned: 0 in 1.015s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5aab0985-bb4a-42f9-b06f-ecf6167d0950 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:43 devstack sudo[92640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5aab0985-bb4a-42f9-b06f-ecf6167d0950 Sep 28 17:08:43 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:43 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:43 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Flow 'volume_create_manager' (e283e025-e807-42cd-9295-472229488d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:43 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59bce882-781f-40b6-b6ac-d9b5739ba96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:43 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59bce882-781f-40b6-b6ac-d9b5739ba96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-536982722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f7a6005-2bb8-4102-91a2-09620b1cde3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1afebf65b054ed488c7efd47c0f4478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:44Z,use_quota=True,user_id='95c83b39bb364ef19defa45935d59d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:43 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f102e2a-1fd6-4146-843e-5adeac227013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f102e2a-1fd6-4146-843e-5adeac227013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a2fb6a-6389-48a7-8bb0-b288ba7880ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a2fb6a-6389-48a7-8bb0-b288ba7880ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f7a6005-2bb8-4102-91a2-09620b1cde3f', 'volume_name': 'volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2340deb-95f3-4788-934b-db536969dcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2340deb-95f3-4788-934b-db536969dcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (724e4cf0-ce4e-4535-9e75-e9f42b0832e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:44 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Volume 8f7a6005-2bb8-4102-91a2-09620b1cde3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f', 'volume_size': 1} Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5aab0985-bb4a-42f9-b06f-ecf6167d0950" returned: 0 in 0.583s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-536982722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f7a6005-2bb8-4102-91a2-09620b1cde3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1afebf65b054ed488c7efd47c0f4478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:44Z,use_quota=True,user_id='95c83b39bb364ef19defa45935d59d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Creating volume 8f7a6005-2bb8-4102-91a2-09620b1cde3f {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:44 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133e7ffd-99da-44b7-91c2-0cde117e4065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aab0985-bb4a-42f9-b06f-ecf6167d0950', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:44 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f 1073741824 Sep 28 17:08:44 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9bf12c-9348-4a38-a4e4-7a52b2f147c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:44 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Volume volume-5aab0985-bb4a-42f9-b06f-ecf6167d0950 (5aab0985-bb4a-42f9-b06f-ecf6167d0950): created successfully Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9bf12c-9348-4a38-a4e4-7a52b2f147c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Flow 'volume_create_manager' (caa42eb8-7d5b-4b7d-8436-39bf8262022a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:44 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-492b80f0-8b65-436a-ac04-1027d1945ac6 tempest-VolumesTestJSON-1134612692 None] Created volume successfully. Sep 28 17:08:44 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f 1073741824" returned: 0 in 0.705s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:44 devstack sudo[92649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f Sep 28 17:08:44 devstack sudo[92649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:45 devstack sudo[92649]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f" returned: 0 in 0.424s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:45 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-3341b8c6-ebfb-4f04-a00e-44b67486a7ae tempest-GroupsV314Test-1343416303 None] Group tempest-GroupsV314Test-Group-410835919: creating Sep 28 17:08:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (724e4cf0-ce4e-4535-9e75-e9f42b0832e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1181695e-b723-4714-bd6b-5aba4aea188d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:45 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Volume volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f (8f7a6005-2bb8-4102-91a2-09620b1cde3f): created successfully Sep 28 17:08:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1181695e-b723-4714-bd6b-5aba4aea188d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Flow 'volume_create_manager' (e283e025-e807-42cd-9295-472229488d53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:45 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-51474e9a-11fb-4e6e-92cb-d793062e8a8c tempest-SnapshotsActionsTest-1770180745 None] Created volume successfully. Sep 28 17:08:45 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-3341b8c6-ebfb-4f04-a00e-44b67486a7ae tempest-GroupsV314Test-1343416303 None] Group tempest-GroupsV314Test-Group-410835919: created successfully Sep 28 17:08:45 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-3341b8c6-ebfb-4f04-a00e-44b67486a7ae tempest-GroupsV314Test-1343416303 None] Create group completed successfully. Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Flow 'volume_create_manager' (4cb8286d-fe64-4f74-a417-525a0643d824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d9b234-fb3d-4a36-8372-44b40d0f1cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d9b234-fb3d-4a36-8372-44b40d0f1cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1131575597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1749a3b8-35a7-4fbe-a912-bb59c8d25b0d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb27bc71d2f5432e948160e51aafa9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:46Z,use_quota=True,user_id='925d89b5a0db4a51967d5c86d8ab607c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c44f7d-65ad-4daf-9fed-72ffd010e61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c44f7d-65ad-4daf-9fed-72ffd010e61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8732360f-fec6-4306-bb5b-7cb2e8e5af77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8732360f-fec6-4306-bb5b-7cb2e8e5af77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1749a3b8-35a7-4fbe-a912-bb59c8d25b0d', 'volume_name': 'volume-1749a3b8-35a7-4fbe-a912-bb59c8d25b0d', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f0b2fe-b165-499f-b718-1ae5abe1a319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f0b2fe-b165-499f-b718-1ae5abe1a319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce5fa0a-8dbd-483f-9515-c0eed18df337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:46 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Volume 1749a3b8-35a7-4fbe-a912-bb59c8d25b0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1749a3b8-35a7-4fbe-a912-bb59c8d25b0d', 'volume_size': 1} Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1131575597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1749a3b8-35a7-4fbe-a912-bb59c8d25b0d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb27bc71d2f5432e948160e51aafa9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:46Z,use_quota=True,user_id='925d89b5a0db4a51967d5c86d8ab607c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Creating volume 1749a3b8-35a7-4fbe-a912-bb59c8d25b0d {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:46 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1749a3b8-35a7-4fbe-a912-bb59c8d25b0d 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:46 devstack sudo[92653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1749a3b8-35a7-4fbe-a912-bb59c8d25b0d 1073741824 Sep 28 17:08:46 devstack sudo[92653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a0a0de59-6c97-432a-9eba-9a62bdbec117 tempest-SnapshotsActionsTest-1770180745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:47 devstack sudo[92653]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1749a3b8-35a7-4fbe-a912-bb59c8d25b0d 1073741824" returned: 0 in 0.966s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1749a3b8-35a7-4fbe-a912-bb59c8d25b0d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:47 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1749a3b8-35a7-4fbe-a912-bb59c8d25b0d Sep 28 17:08:47 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:47 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Flow 'volume_create_manager' (5a41eceb-0efb-42fa-80a4-7612dba7a3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8740bb18-7844-43fa-90e5-431767d9f81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:47 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1749a3b8-35a7-4fbe-a912-bb59c8d25b0d" returned: 0 in 0.515s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a0a0de59-6c97-432a-9eba-9a62bdbec117 tempest-SnapshotsActionsTest-1770180745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.356s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8740bb18-7844-43fa-90e5-431767d9f81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-379113229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4b4fd5b7-76d1-4117-96f1-6269750a4c74,host='devstack@QuobyteHD#QuobyteHD',id=58c4d574-3709-488d-afa6-40930fda7f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd06fdfe953c4c158a1027828ae40c71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:48Z,use_quota=True,user_id='0f5c418721a24f579c75e7100c6417ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(469a32f2-0b64-4363-b802-1be729134edd),volume_type_id=469a32f2-0b64-4363-b802-1be729134edd)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c0fdbc3-0ebe-4515-8201-94217e3dbfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c0fdbc3-0ebe-4515-8201-94217e3dbfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554065b7-4ee0-421b-8d2b-ff55b2a5de11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554065b7-4ee0-421b-8d2b-ff55b2a5de11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58c4d574-3709-488d-afa6-40930fda7f74', 'volume_name': 'volume-58c4d574-3709-488d-afa6-40930fda7f74', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1019b472-1c4c-4dcf-9612-f7487a8beee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1019b472-1c4c-4dcf-9612-f7487a8beee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3968c2b-2b88-4ac3-a3bc-3e737401b4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:48 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Volume 58c4d574-3709-488d-afa6-40930fda7f74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58c4d574-3709-488d-afa6-40930fda7f74', 'volume_size': 1} Sep 28 17:08:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce5fa0a-8dbd-483f-9515-c0eed18df337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1749a3b8-35a7-4fbe-a912-bb59c8d25b0d', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7cc07de-4cc6-4a54-bf50-547826b44a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:48 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Volume volume-1749a3b8-35a7-4fbe-a912-bb59c8d25b0d (1749a3b8-35a7-4fbe-a912-bb59c8d25b0d): created successfully Sep 28 17:08:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7cc07de-4cc6-4a54-bf50-547826b44a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Flow 'volume_create_manager' (4cb8286d-fe64-4f74-a417-525a0643d824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:48 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-a0a0de59-6c97-432a-9eba-9a62bdbec117 tempest-SnapshotsActionsTest-1770180745 None] Creating offline snapshot 97e954a1-93f9-4583-be30-a33fd8cdff41 of volume 8f7a6005-2bb8-4102-91a2-09620b1cde3f {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:08:48 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-610b2759-ecbf-4020-a8c0-f0682438a589 tempest-VolumesTestJSON-1134612692 None] Created volume successfully. Sep 28 17:08:48 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b383d8a5-25f0-4655-a595-757afd534272]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0a0de59-6c97-432a-9eba-9a62bdbec117 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:48 devstack sudo[93105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f Sep 28 17:08:48 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:48 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0a0de59-6c97-432a-9eba-9a62bdbec117 tempest-SnapshotsActionsTest-1770180745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f" returned: 0 in 0.662s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0a0de59-6c97-432a-9eba-9a62bdbec117 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:48 devstack sudo[93121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 1G Sep 28 17:08:48 devstack sudo[93121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:49 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Flow 'volume_create_manager' (9fab7b15-c882-45cf-a51a-3cba86ad4a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0a3cb3-25e4-4a52-a877-c8a0b3913430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0a3cb3-25e4-4a52-a877-c8a0b3913430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1218152540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fffa2283-5b77-4db3-be2a-ebfa839c9bc4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb27bc71d2f5432e948160e51aafa9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:49Z,use_quota=True,user_id='925d89b5a0db4a51967d5c86d8ab607c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b31c979-d25b-4787-a0ee-f3f3cacb8ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b31c979-d25b-4787-a0ee-f3f3cacb8ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e119b88-9080-44a9-8f89-db51617183f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e119b88-9080-44a9-8f89-db51617183f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fffa2283-5b77-4db3-be2a-ebfa839c9bc4', 'volume_name': 'volume-fffa2283-5b77-4db3-be2a-ebfa839c9bc4', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e00f7221-a8f6-4a1a-bd59-ccacfe7c8d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e00f7221-a8f6-4a1a-bd59-ccacfe7c8d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7072ae5a-8104-43ff-acf7-2d86d528a5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:49 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Volume fffa2283-5b77-4db3-be2a-ebfa839c9bc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fffa2283-5b77-4db3-be2a-ebfa839c9bc4', 'volume_size': 1} Sep 28 17:08:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:49 devstack sudo[93121]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0a0de59-6c97-432a-9eba-9a62bdbec117 tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 1G" returned: 0 in 0.608s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0a0de59-6c97-432a-9eba-9a62bdbec117 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:49 devstack sudo[93141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 Sep 28 17:08:49 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:49 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0a0de59-6c97-432a-9eba-9a62bdbec117 tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41" returned: 0 in 0.426s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:49 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-a0a0de59-6c97-432a-9eba-9a62bdbec117 tempest-SnapshotsActionsTest-1770180745 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 is being set with open permissions: ugo+rw Sep 28 17:08:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0a0de59-6c97-432a-9eba-9a62bdbec117 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:49 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 Sep 28 17:08:49 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:50 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0a0de59-6c97-432a-9eba-9a62bdbec117 tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41" returned: 0 in 0.377s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0a0de59-6c97-432a-9eba-9a62bdbec117 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:50 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.info Sep 28 17:08:50 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:50 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0a0de59-6c97-432a-9eba-9a62bdbec117 tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.info" returned: 0 in 0.440s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:50 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-a0a0de59-6c97-432a-9eba-9a62bdbec117 tempest-SnapshotsActionsTest-1770180745 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.info is being set with open permissions: ugo+rw Sep 28 17:08:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0a0de59-6c97-432a-9eba-9a62bdbec117 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:50 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.info Sep 28 17:08:50 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:51 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0a0de59-6c97-432a-9eba-9a62bdbec117 tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.info" returned: 0 in 0.338s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a0a0de59-6c97-432a-9eba-9a62bdbec117 tempest-SnapshotsActionsTest-1770180745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.217s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.086s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4b4fd5b7-76d1-4117-96f1-6269750a4c74,created_at=2026-09-28T15:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-379113229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4b4fd5b7-76d1-4117-96f1-6269750a4c74,host='devstack@QuobyteHD#QuobyteHD',id=58c4d574-3709-488d-afa6-40930fda7f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd06fdfe953c4c158a1027828ae40c71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:48Z,use_quota=True,user_id='0f5c418721a24f579c75e7100c6417ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(469a32f2-0b64-4363-b802-1be729134edd),volume_type_id=469a32f2-0b64-4363-b802-1be729134edd)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Creating volume 58c4d574-3709-488d-afa6-40930fda7f74 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:51 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:08:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:51 devstack sudo[93158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74 1073741824 Sep 28 17:08:51 devstack sudo[93158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:51 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a0a0de59-6c97-432a-9eba-9a62bdbec117 tempest-SnapshotsActionsTest-1770180745 None] Create snapshot completed successfully Sep 28 17:08:51 devstack sudo[93158]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74 1073741824" returned: 0 in 0.787s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:52 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74 Sep 28 17:08:52 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:52 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74" returned: 0 in 0.415s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:52 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.070s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:52 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1218152540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fffa2283-5b77-4db3-be2a-ebfa839c9bc4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb27bc71d2f5432e948160e51aafa9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:49Z,use_quota=True,user_id='925d89b5a0db4a51967d5c86d8ab607c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:52 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Creating volume fffa2283-5b77-4db3-be2a-ebfa839c9bc4 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:52 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:52 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:52 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:52 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:08:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fffa2283-5b77-4db3-be2a-ebfa839c9bc4 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:52 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fffa2283-5b77-4db3-be2a-ebfa839c9bc4 1073741824 Sep 28 17:08:52 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:52 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3968c2b-2b88-4ac3-a3bc-3e737401b4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58c4d574-3709-488d-afa6-40930fda7f74', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:52 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4285b0d-405b-4456-977a-e1e5fc59a88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:52 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Volume volume-58c4d574-3709-488d-afa6-40930fda7f74 (58c4d574-3709-488d-afa6-40930fda7f74): created successfully Sep 28 17:08:52 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4285b0d-405b-4456-977a-e1e5fc59a88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:52 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Flow 'volume_create_manager' (5a41eceb-0efb-42fa-80a4-7612dba7a3ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:52 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-03a66888-7578-499a-8c4d-35b2bd614f0b tempest-GroupsV314Test-1343416303 None] Created volume successfully. Sep 28 17:08:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ca9ac4c8-7ba2-42a9-8f99-41f44d06cd03 tempest-SnapshotsActionsTest-1770180745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:53 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fffa2283-5b77-4db3-be2a-ebfa839c9bc4 1073741824" returned: 0 in 0.981s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fffa2283-5b77-4db3-be2a-ebfa839c9bc4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:53 devstack sudo[93175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fffa2283-5b77-4db3-be2a-ebfa839c9bc4 Sep 28 17:08:53 devstack sudo[93175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:53 devstack sudo[93175]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fffa2283-5b77-4db3-be2a-ebfa839c9bc4" returned: 0 in 0.356s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ca9ac4c8-7ba2-42a9-8f99-41f44d06cd03 tempest-SnapshotsActionsTest-1770180745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.557s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7072ae5a-8104-43ff-acf7-2d86d528a5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fffa2283-5b77-4db3-be2a-ebfa839c9bc4', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdce6437-30d9-4a63-ada3-5867d60684db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-ca9ac4c8-7ba2-42a9-8f99-41f44d06cd03 tempest-SnapshotsActionsTest-1770180745 None] Creating offline snapshot 7204a493-0b3b-4868-b70d-c2ac69dbe620 of volume 8f7a6005-2bb8-4102-91a2-09620b1cde3f {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:08:54 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Volume volume-fffa2283-5b77-4db3-be2a-ebfa839c9bc4 (fffa2283-5b77-4db3-be2a-ebfa839c9bc4): created successfully Sep 28 17:08:54 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdce6437-30d9-4a63-ada3-5867d60684db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:54 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Flow 'volume_create_manager' (9fab7b15-c882-45cf-a51a-3cba86ad4a95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:54 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b778a4-2026-4f09-8d5a-ff47ac97a3d0]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ca9ac4c8-7ba2-42a9-8f99-41f44d06cd03 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:54 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a49d4f05-d3ee-4cab-8a70-21a22793c09b tempest-VolumesTestJSON-1134612692 None] Created volume successfully. Sep 28 17:08:54 devstack sudo[93178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 Sep 28 17:08:54 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:54 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ca9ac4c8-7ba2-42a9-8f99-41f44d06cd03 tempest-SnapshotsActionsTest-1770180745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41" returned: 0 in 0.716s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:54 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-ca9ac4c8-7ba2-42a9-8f99-41f44d06cd03 tempest-SnapshotsActionsTest-1770180745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:08:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ca9ac4c8-7ba2-42a9-8f99-41f44d06cd03 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.7204a493-0b3b-4868-b70d-c2ac69dbe620 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:54 devstack sudo[93183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.7204a493-0b3b-4868-b70d-c2ac69dbe620 1G Sep 28 17:08:54 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:55 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ca9ac4c8-7ba2-42a9-8f99-41f44d06cd03 tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.7204a493-0b3b-4868-b70d-c2ac69dbe620 1G" returned: 0 in 0.929s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ca9ac4c8-7ba2-42a9-8f99-41f44d06cd03 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.7204a493-0b3b-4868-b70d-c2ac69dbe620 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:55 devstack sudo[93190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.7204a493-0b3b-4868-b70d-c2ac69dbe620 Sep 28 17:08:55 devstack sudo[93190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:56 devstack sudo[93190]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ca9ac4c8-7ba2-42a9-8f99-41f44d06cd03 tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.7204a493-0b3b-4868-b70d-c2ac69dbe620" returned: 0 in 0.630s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:56 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-ca9ac4c8-7ba2-42a9-8f99-41f44d06cd03 tempest-SnapshotsActionsTest-1770180745 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.7204a493-0b3b-4868-b70d-c2ac69dbe620 is being set with open permissions: ugo+rw Sep 28 17:08:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ca9ac4c8-7ba2-42a9-8f99-41f44d06cd03 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.7204a493-0b3b-4868-b70d-c2ac69dbe620 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:56 devstack sudo[93195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.7204a493-0b3b-4868-b70d-c2ac69dbe620 Sep 28 17:08:56 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:56 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f331294a-ab35-46ea-852c-f3641d5c9fc3 tempest-VolumesTestJSON-1134612692 None] Acquiring lock "cinder-fffa2283-5b77-4db3-be2a-ebfa839c9bc4-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:56 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f331294a-ab35-46ea-852c-f3641d5c9fc3 tempest-VolumesTestJSON-1134612692 None] Lock "cinder-fffa2283-5b77-4db3-be2a-ebfa839c9bc4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:56 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f331294a-ab35-46ea-852c-f3641d5c9fc3 tempest-VolumesTestJSON-1134612692 None] Acquiring lock "cinder-quobyte-fffa2283-5b77-4db3-be2a-ebfa839c9bc4" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:56 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f331294a-ab35-46ea-852c-f3641d5c9fc3 tempest-VolumesTestJSON-1134612692 None] Lock "cinder-quobyte-fffa2283-5b77-4db3-be2a-ebfa839c9bc4" acquired by "delete_volume" :: waited 0.030s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:56 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09734c3-2aad-4552-b00c-4dd6243e0f7b]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f331294a-ab35-46ea-852c-f3641d5c9fc3 tempest-VolumesTestJSON-1134612692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fffa2283-5b77-4db3-be2a-ebfa839c9bc4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:56 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ca9ac4c8-7ba2-42a9-8f99-41f44d06cd03 tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.7204a493-0b3b-4868-b70d-c2ac69dbe620" returned: 0 in 0.571s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ca9ac4c8-7ba2-42a9-8f99-41f44d06cd03 tempest-SnapshotsActionsTest-1770180745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.099s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.667s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:57 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Cloning volume 58c4d574-3709-488d-afa6-40930fda7f74 to volume 549a2864-2adb-4d00-8dc0-1b85f25d33a6 Sep 28 17:08:57 devstack sudo[93199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fffa2283-5b77-4db3-be2a-ebfa839c9bc4 Sep 28 17:08:57 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:57 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-ca9ac4c8-7ba2-42a9-8f99-41f44d06cd03 tempest-SnapshotsActionsTest-1770180745 None] Create snapshot completed successfully Sep 28 17:08:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Creating offline snapshot 96865878-99b1-4f92-b18a-d3723095f81a of volume 58c4d574-3709-488d-afa6-40930fda7f74 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:08:57 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7dea18-17c7-4667-a4a8-b71f191e033a]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:57 devstack sudo[93201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74 Sep 28 17:08:57 devstack sudo[93201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:57 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f331294a-ab35-46ea-852c-f3641d5c9fc3 tempest-VolumesTestJSON-1134612692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fffa2283-5b77-4db3-be2a-ebfa839c9bc4" returned: 0 in 1.165s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f331294a-ab35-46ea-852c-f3641d5c9fc3 tempest-VolumesTestJSON-1134612692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fffa2283-5b77-4db3-be2a-ebfa839c9bc4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:58 devstack sudo[93240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fffa2283-5b77-4db3-be2a-ebfa839c9bc4 Sep 28 17:08:58 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:58 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] Acquiring lock "cinder-7204a493-0b3b-4868-b70d-c2ac69dbe620-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:58 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-7204a493-0b3b-4868-b70d-c2ac69dbe620-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:58 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] Acquiring lock "cinder-quobyte-8f7a6005-2bb8-4102-91a2-09620b1cde3f" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:58 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-quobyte-8f7a6005-2bb8-4102-91a2-09620b1cde3f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:58 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] Acquiring lock "cinder-quobyte-7204a493-0b3b-4868-b70d-c2ac69dbe620" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:58 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-quobyte-7204a493-0b3b-4868-b70d-c2ac69dbe620" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] Deleting offline snapshot 7204a493-0b3b-4868-b70d-c2ac69dbe620 of volume 8f7a6005-2bb8-4102-91a2-09620b1cde3f {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:08:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] snapshot_file for this snap is: volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.7204a493-0b3b-4868-b70d-c2ac69dbe620 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:08:58 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74d3a3e-ed18-4e2c-8276-3c302831e8d8]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.7204a493-0b3b-4868-b70d-c2ac69dbe620 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:58 devstack sudo[93201]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74" returned: 0 in 1.181s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:58 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a 1G Sep 28 17:08:58 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:58 devstack sudo[93245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.7204a493-0b3b-4868-b70d-c2ac69dbe620 Sep 28 17:08:58 devstack sudo[93245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:58 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f331294a-ab35-46ea-852c-f3641d5c9fc3 tempest-VolumesTestJSON-1134612692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fffa2283-5b77-4db3-be2a-ebfa839c9bc4" returned: 0 in 0.893s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:58 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f331294a-ab35-46ea-852c-f3641d5c9fc3 tempest-VolumesTestJSON-1134612692 None] Lock "cinder-quobyte-fffa2283-5b77-4db3-be2a-ebfa839c9bc4" released by "delete_volume" :: held 2.174s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:59 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-f331294a-ab35-46ea-852c-f3641d5c9fc3 tempest-VolumesTestJSON-1134612692 None] Created reservations ['4ba9b1b2-2233-46ba-b7e2-9de4d05cfe20', 'c1125328-5187-4709-ad6a-e9e1341bc707', 'e3e4ce40-7e3a-4ea6-b668-f13baae0da48', 'deea8c92-9d4f-4279-ac41-b16547595c15'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:59 devstack sudo[93245]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.7204a493-0b3b-4868-b70d-c2ac69dbe620" returned: 0 in 0.877s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:08:59 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb71a8c-9f77-4a82-807e-e3e87ec55869]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f331294a-ab35-46ea-852c-f3641d5c9fc3 tempest-VolumesTestJSON-1134612692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f331294a-ab35-46ea-852c-f3641d5c9fc3 tempest-VolumesTestJSON-1134612692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f331294a-ab35-46ea-852c-f3641d5c9fc3 tempest-VolumesTestJSON-1134612692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:59 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 Sep 28 17:08:59 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f331294a-ab35-46ea-852c-f3641d5c9fc3 tempest-VolumesTestJSON-1134612692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f331294a-ab35-46ea-852c-f3641d5c9fc3 tempest-VolumesTestJSON-1134612692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f331294a-ab35-46ea-852c-f3641d5c9fc3 tempest-VolumesTestJSON-1134612692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:59 devstack sudo[93262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:08:59 devstack sudo[93262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:59 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a 1G" returned: 0 in 1.213s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58c4d574-3709-488d-afa6-40930fda7f74 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:59 devstack sudo[93264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58c4d574-3709-488d-afa6-40930fda7f74 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a Sep 28 17:08:59 devstack sudo[93264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:59 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41" returned: 0 in 0.633s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:08:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.7204a493-0b3b-4868-b70d-c2ac69dbe620 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:59 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.7204a493-0b3b-4868-b70d-c2ac69dbe620 Sep 28 17:08:59 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:59 devstack sudo[93262]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f331294a-ab35-46ea-852c-f3641d5c9fc3 tempest-VolumesTestJSON-1134612692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.513s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:59 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-f331294a-ab35-46ea-852c-f3641d5c9fc3 tempest-VolumesTestJSON-1134612692 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:59 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-f331294a-ab35-46ea-852c-f3641d5c9fc3 tempest-VolumesTestJSON-1134612692 None] Deleted volume successfully. Sep 28 17:09:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f331294a-ab35-46ea-852c-f3641d5c9fc3 tempest-VolumesTestJSON-1134612692 None] Lock "cinder-fffa2283-5b77-4db3-be2a-ebfa839c9bc4-delete_volume" released by "delete_volume" :: held 3.452s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:00 devstack sudo[93264]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58c4d574-3709-488d-afa6-40930fda7f74 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a" returned: 0 in 0.660s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:00 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:09:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:00 devstack sudo[93277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a Sep 28 17:09:00 devstack sudo[93277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-08b7501b-9a88-4ca1-b84c-7148819be1d7 tempest-VolumesTestJSON-1134612692 None] Acquiring lock "cinder-1749a3b8-35a7-4fbe-a912-bb59c8d25b0d-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-08b7501b-9a88-4ca1-b84c-7148819be1d7 tempest-VolumesTestJSON-1134612692 None] Lock "cinder-1749a3b8-35a7-4fbe-a912-bb59c8d25b0d-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-08b7501b-9a88-4ca1-b84c-7148819be1d7 tempest-VolumesTestJSON-1134612692 None] Acquiring lock "cinder-quobyte-1749a3b8-35a7-4fbe-a912-bb59c8d25b0d" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-08b7501b-9a88-4ca1-b84c-7148819be1d7 tempest-VolumesTestJSON-1134612692 None] Lock "cinder-quobyte-1749a3b8-35a7-4fbe-a912-bb59c8d25b0d" acquired by "delete_volume" :: waited 0.043s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:00 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5e8bd0-c493-4899-a6c6-26da9b60847c]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08b7501b-9a88-4ca1-b84c-7148819be1d7 tempest-VolumesTestJSON-1134612692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1749a3b8-35a7-4fbe-a912-bb59c8d25b0d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:00 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.7204a493-0b3b-4868-b70d-c2ac69dbe620" returned: 0 in 1.058s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.7204a493-0b3b-4868-b70d-c2ac69dbe620 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:00 devstack sudo[93277]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a" returned: 0 in 0.684s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:00 devstack sudo[93286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.7204a493-0b3b-4868-b70d-c2ac69dbe620 Sep 28 17:09:00 devstack sudo[93286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:01 devstack sudo[93284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1749a3b8-35a7-4fbe-a912-bb59c8d25b0d Sep 28 17:09:01 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:01 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.info Sep 28 17:09:01 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:01 devstack sudo[93286]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.7204a493-0b3b-4868-b70d-c2ac69dbe620" returned: 0 in 0.378s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:01 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-quobyte-7204a493-0b3b-4868-b70d-c2ac69dbe620" released by "_delete_snapshot" :: held 3.189s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:01 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-quobyte-8f7a6005-2bb8-4102-91a2-09620b1cde3f" released by "delete_snapshot" :: held 3.240s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:01 devstack cinder-volume[87061]: WARNING cinder.quota [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:09:01 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] Created reservations ['75289008-7bca-4e8a-af76-52aa5711e96b', 'ecb9e1c2-f8d5-479e-b4f5-bea28bd8d60e', '6df77522-8061-43a3-a1d1-319baffc972a', '7e5b4412-4b65-4601-b577-ef3d5a0700fb'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:01 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08b7501b-9a88-4ca1-b84c-7148819be1d7 tempest-VolumesTestJSON-1134612692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1749a3b8-35a7-4fbe-a912-bb59c8d25b0d" returned: 0 in 0.820s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08b7501b-9a88-4ca1-b84c-7148819be1d7 tempest-VolumesTestJSON-1134612692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1749a3b8-35a7-4fbe-a912-bb59c8d25b0d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:01 devstack sudo[93296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1749a3b8-35a7-4fbe-a912-bb59c8d25b0d Sep 28 17:09:01 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:01 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.info" returned: 0 in 0.625s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:01 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:09:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:01 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] Delete snapshot completed successfully. Sep 28 17:09:01 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2d40a630-9a0a-4718-8951-531b6eb62d75 tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-7204a493-0b3b-4868-b70d-c2ac69dbe620-delete_snapshot" released by "delete_snapshot" :: held 3.615s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:01 devstack sudo[93298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.info Sep 28 17:09:01 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:02 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:02 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08b7501b-9a88-4ca1-b84c-7148819be1d7 tempest-VolumesTestJSON-1134612692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1749a3b8-35a7-4fbe-a912-bb59c8d25b0d" returned: 0 in 0.665s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.info" returned: 0 in 0.570s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:02 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Acquiring lock "cinder-quobyte-549a2864-2adb-4d00-8dc0-1b85f25d33a6" by "_copy_volume_from_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:02 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-08b7501b-9a88-4ca1-b84c-7148819be1d7 tempest-VolumesTestJSON-1134612692 None] Lock "cinder-quobyte-1749a3b8-35a7-4fbe-a912-bb59c8d25b0d" released by "delete_volume" :: held 1.629s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:02 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Lock "cinder-quobyte-549a2864-2adb-4d00-8dc0-1b85f25d33a6" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] snapshot: 96865878-99b1-4f92-b18a-d3723095f81a, volume: 549a2864-2adb-4d00-8dc0-1b85f25d33a6, {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:09:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:02 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed7a6cd-e384-4021-b3f1-7d6f6c08feb7]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:02 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-08b7501b-9a88-4ca1-b84c-7148819be1d7 tempest-VolumesTestJSON-1134612692 None] Created reservations ['36a0bf7e-8bf4-4ac4-bc7c-48ebf93733dd', '61df197d-eb63-4853-ae93-3d98acdf1792', '7ec0ad6d-da59-4f29-b2d9-229ac80aaf3f', '24240eaa-e5cc-41a9-a331-5630c6f9693a'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:02 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a Sep 28 17:09:02 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08b7501b-9a88-4ca1-b84c-7148819be1d7 tempest-VolumesTestJSON-1134612692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08b7501b-9a88-4ca1-b84c-7148819be1d7 tempest-VolumesTestJSON-1134612692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-08b7501b-9a88-4ca1-b84c-7148819be1d7 tempest-VolumesTestJSON-1134612692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-08b7501b-9a88-4ca1-b84c-7148819be1d7 tempest-VolumesTestJSON-1134612692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08b7501b-9a88-4ca1-b84c-7148819be1d7 tempest-VolumesTestJSON-1134612692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08b7501b-9a88-4ca1-b84c-7148819be1d7 tempest-VolumesTestJSON-1134612692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:02 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:09:02 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:02 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a3212228-9171-4546-aaa8-bba87b237392 tempest-VolumesTestJSON-1134612692 None] Acquiring lock "cinder-5aab0985-bb4a-42f9-b06f-ecf6167d0950-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a3212228-9171-4546-aaa8-bba87b237392 tempest-VolumesTestJSON-1134612692 None] Lock "cinder-5aab0985-bb4a-42f9-b06f-ecf6167d0950-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a3212228-9171-4546-aaa8-bba87b237392 tempest-VolumesTestJSON-1134612692 None] Acquiring lock "cinder-quobyte-5aab0985-bb4a-42f9-b06f-ecf6167d0950" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a3212228-9171-4546-aaa8-bba87b237392 tempest-VolumesTestJSON-1134612692 None] Lock "cinder-quobyte-5aab0985-bb4a-42f9-b06f-ecf6167d0950" acquired by "delete_volume" :: waited 0.049s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:03 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a" returned: 0 in 0.906s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58c4d574-3709-488d-afa6-40930fda7f74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:09:03 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df40d98-2076-4b8b-8836-b50088953ad7]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3212228-9171-4546-aaa8-bba87b237392 tempest-VolumesTestJSON-1134612692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5aab0985-bb4a-42f9-b06f-ecf6167d0950 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:03 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f961b71f-cc2d-42f7-847f-1261308b03e0]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:03 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5aab0985-bb4a-42f9-b06f-ecf6167d0950 Sep 28 17:09:03 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:03 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:03 devstack sudo[93314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74 Sep 28 17:09:03 devstack sudo[93314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08b7501b-9a88-4ca1-b84c-7148819be1d7 tempest-VolumesTestJSON-1134612692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.852s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:03 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-08b7501b-9a88-4ca1-b84c-7148819be1d7 tempest-VolumesTestJSON-1134612692 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-750ad795-5f26-4375-b840-ca3d2e794afd tempest-SnapshotsActionsTest-1770180745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:03 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-08b7501b-9a88-4ca1-b84c-7148819be1d7 tempest-VolumesTestJSON-1134612692 None] Deleted volume successfully. Sep 28 17:09:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-08b7501b-9a88-4ca1-b84c-7148819be1d7 tempest-VolumesTestJSON-1134612692 None] Lock "cinder-1749a3b8-35a7-4fbe-a912-bb59c8d25b0d-delete_volume" released by "delete_volume" :: held 3.169s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:03 devstack sudo[93314]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74" returned: 0 in 0.557s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74 {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:09:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Creating direct copy from snapshot {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:09:03 devstack cinder-volume[87061]: DEBUG cinder.utils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Path /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-549a2864-2adb-4d00-8dc0-1b85f25d33a6 not found in is_blk_device check {{(pid=87061) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:09:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-549a2864-2adb-4d00-8dc0-1b85f25d33a6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:03 devstack sudo[93323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-549a2864-2adb-4d00-8dc0-1b85f25d33a6 Sep 28 17:09:03 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:04 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3212228-9171-4546-aaa8-bba87b237392 tempest-VolumesTestJSON-1134612692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5aab0985-bb4a-42f9-b06f-ecf6167d0950" returned: 0 in 0.764s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3212228-9171-4546-aaa8-bba87b237392 tempest-VolumesTestJSON-1134612692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5aab0985-bb4a-42f9-b06f-ecf6167d0950 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:04 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5aab0985-bb4a-42f9-b06f-ecf6167d0950 Sep 28 17:09:04 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:04 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3212228-9171-4546-aaa8-bba87b237392 tempest-VolumesTestJSON-1134612692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5aab0985-bb4a-42f9-b06f-ecf6167d0950" returned: 0 in 0.566s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a3212228-9171-4546-aaa8-bba87b237392 tempest-VolumesTestJSON-1134612692 None] Lock "cinder-quobyte-5aab0985-bb4a-42f9-b06f-ecf6167d0950" released by "delete_volume" :: held 1.462s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:04 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-a3212228-9171-4546-aaa8-bba87b237392 tempest-VolumesTestJSON-1134612692 None] Created reservations ['e4a822d4-b128-415e-a110-4861b1cb56ee', 'c1692adf-7a1c-456f-8d6e-2055eb7229e5', '55e623f2-79b4-4e6a-8665-0817faaee3bb', 'd3d5e6e4-8173-493f-bacc-d8565e53f293'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:05 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-1cfc4cf4-5932-4b3f-831c-8b5b43476868 req-426fbb8a-e997-4056-970d-c259d17d83c1 tempest-ServerActionsTestOtherA-1604287769 None] Terminate volume connection completed successfully. Sep 28 17:09:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-1cfc4cf4-5932-4b3f-831c-8b5b43476868 req-426fbb8a-e997-4056-970d-c259d17d83c1 tempest-ServerActionsTestOtherA-1604287769 None] Deleting attachment 994ece9b-8d95-4cf2-8b44-2a2269379026. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:09:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a3212228-9171-4546-aaa8-bba87b237392 tempest-VolumesTestJSON-1134612692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a3212228-9171-4546-aaa8-bba87b237392 tempest-VolumesTestJSON-1134612692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a3212228-9171-4546-aaa8-bba87b237392 tempest-VolumesTestJSON-1134612692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a3212228-9171-4546-aaa8-bba87b237392 tempest-VolumesTestJSON-1134612692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a3212228-9171-4546-aaa8-bba87b237392 tempest-VolumesTestJSON-1134612692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3212228-9171-4546-aaa8-bba87b237392 tempest-VolumesTestJSON-1134612692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:05 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:09:05 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:06 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3212228-9171-4546-aaa8-bba87b237392 tempest-VolumesTestJSON-1134612692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.814s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:06 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-a3212228-9171-4546-aaa8-bba87b237392 tempest-VolumesTestJSON-1134612692 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:06 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a3212228-9171-4546-aaa8-bba87b237392 tempest-VolumesTestJSON-1134612692 None] Deleted volume successfully. Sep 28 17:09:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a3212228-9171-4546-aaa8-bba87b237392 tempest-VolumesTestJSON-1134612692 None] Lock "cinder-5aab0985-bb4a-42f9-b06f-ecf6167d0950-delete_volume" released by "delete_volume" :: held 3.132s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:09:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:06 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:09:06 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:07 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.600s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:09:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:09:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:09:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-1cfc4cf4-5932-4b3f-831c-8b5b43476868 req-c8753b3c-4f24-4190-afb1-b4ae333a0521 tempest-ServerActionsTestOtherA-1604287769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:13 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-549a2864-2adb-4d00-8dc0-1b85f25d33a6" returned: 0 in 9.708s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:13 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Image conversion details: src /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74, size 1024.00 MB, duration 9.71 sec, destination /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-549a2864-2adb-4d00-8dc0-1b85f25d33a6 {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:09:13 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Converted 1024.00 MB image at 105.46 MB/s Sep 28 17:09:13 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-549a2864-2adb-4d00-8dc0-1b85f25d33a6 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:09:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-549a2864-2adb-4d00-8dc0-1b85f25d33a6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:13 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-549a2864-2adb-4d00-8dc0-1b85f25d33a6 Sep 28 17:09:13 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:13 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-549a2864-2adb-4d00-8dc0-1b85f25d33a6" returned: 0 in 0.342s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Lock "cinder-quobyte-549a2864-2adb-4d00-8dc0-1b85f25d33a6" released by "_copy_volume_from_snapshot" :: held 11.694s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Acquiring lock "cinder-quobyte-96865878-99b1-4f92-b18a-d3723095f81a" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Lock "cinder-quobyte-96865878-99b1-4f92-b18a-d3723095f81a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:14 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Deleting offline snapshot 96865878-99b1-4f92-b18a-d3723095f81a of volume 58c4d574-3709-488d-afa6-40930fda7f74 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:09:14 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] snapshot_file for this snap is: volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:09:14 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbb315c-33ef-4303-b516-5c45abe1094e]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:14 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a Sep 28 17:09:14 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:14 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a" returned: 0 in 0.458s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:14 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58c4d574-3709-488d-afa6-40930fda7f74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:09:14 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e72dd0e-d4bd-4e21-b80b-ede1a8166aa3]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:14 devstack sudo[93423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74 Sep 28 17:09:14 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-437332fc-7f68-46b5-b932-8b5e5235e01a tempest-BackendsCapabilitiesAdminTestsJSON-127834184 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.12845993042, 'free_capacity_gb': 1775.12845993042, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87061) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 17:09:15 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74" returned: 0 in 0.654s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:15 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a Sep 28 17:09:15 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-bffeec52-93be-4c4f-81bf-d1127c6386ad tempest-BackendsCapabilitiesAdminTestsJSON-127834184 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.12845993042, 'free_capacity_gb': 1775.12845993042, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87061) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 17:09:15 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a" returned: 0 in 0.466s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:15 devstack sudo[93435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a Sep 28 17:09:15 devstack sudo[93435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:16 devstack sudo[93435]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74.96865878-99b1-4f92-b18a-d3723095f81a" returned: 0 in 0.288s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Lock "cinder-quobyte-96865878-99b1-4f92-b18a-d3723095f81a" released by "_delete_snapshot" :: held 2.010s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.092s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-750ad795-5f26-4375-b840-ca3d2e794afd tempest-SnapshotsActionsTest-1770180745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.533s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-750ad795-5f26-4375-b840-ca3d2e794afd tempest-SnapshotsActionsTest-1770180745 None] Creating offline snapshot afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a of volume 8f7a6005-2bb8-4102-91a2-09620b1cde3f {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:09:16 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09e98d3-e472-4843-ba45-b42ac9a0fac1]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-750ad795-5f26-4375-b840-ca3d2e794afd tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:16 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-62f8a163-50de-4970-bf65-e7abcf89d2c2 tempest-GroupsV314Test-1343416303 None] Create group from source-group-4b4fd5b7-76d1-4117-96f1-6269750a4c74 completed successfully. Sep 28 17:09:16 devstack sudo[93438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 Sep 28 17:09:16 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:16 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-750ad795-5f26-4375-b840-ca3d2e794afd tempest-SnapshotsActionsTest-1770180745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41" returned: 0 in 0.471s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-750ad795-5f26-4375-b840-ca3d2e794afd tempest-SnapshotsActionsTest-1770180745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:09:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-750ad795-5f26-4375-b840-ca3d2e794afd tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:16 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a 1G Sep 28 17:09:16 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:17 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-750ad795-5f26-4375-b840-ca3d2e794afd tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a 1G" returned: 0 in 0.705s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-750ad795-5f26-4375-b840-ca3d2e794afd tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:17 devstack sudo[93450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a Sep 28 17:09:17 devstack sudo[93450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:17 devstack sudo[93450]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-750ad795-5f26-4375-b840-ca3d2e794afd tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a" returned: 0 in 0.364s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:17 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-750ad795-5f26-4375-b840-ca3d2e794afd tempest-SnapshotsActionsTest-1770180745 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a is being set with open permissions: ugo+rw Sep 28 17:09:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-750ad795-5f26-4375-b840-ca3d2e794afd tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:17 devstack sudo[93455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a Sep 28 17:09:17 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-738b7ebd-d962-4659-94cb-8df746d517e5 tempest-GroupsV314Test-1343416303 None] Acquiring lock "cinder-quobyte-549a2864-2adb-4d00-8dc0-1b85f25d33a6" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-738b7ebd-d962-4659-94cb-8df746d517e5 tempest-GroupsV314Test-1343416303 None] Lock "cinder-quobyte-549a2864-2adb-4d00-8dc0-1b85f25d33a6" acquired by "delete_volume" :: waited 0.032s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:18 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[91832eda-8bbe-4bd6-bf46-02b51ce7fed9]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-738b7ebd-d962-4659-94cb-8df746d517e5 tempest-GroupsV314Test-1343416303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-549a2864-2adb-4d00-8dc0-1b85f25d33a6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:18 devstack sudo[93457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-549a2864-2adb-4d00-8dc0-1b85f25d33a6 Sep 28 17:09:18 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:18 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-750ad795-5f26-4375-b840-ca3d2e794afd tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a" returned: 0 in 0.434s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-750ad795-5f26-4375-b840-ca3d2e794afd tempest-SnapshotsActionsTest-1770180745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.132s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-1cfc4cf4-5932-4b3f-831c-8b5b43476868 req-c8753b3c-4f24-4190-afb1-b4ae333a0521 tempest-ServerActionsTestOtherA-1604287769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.452s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-1cfc4cf4-5932-4b3f-831c-8b5b43476868 req-c8753b3c-4f24-4190-afb1-b4ae333a0521 tempest-ServerActionsTestOtherA-1604287769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.081s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:18 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-750ad795-5f26-4375-b840-ca3d2e794afd tempest-SnapshotsActionsTest-1770180745 None] Create snapshot completed successfully Sep 28 17:09:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-1cfc4cf4-5932-4b3f-831c-8b5b43476868 req-c8753b3c-4f24-4190-afb1-b4ae333a0521 tempest-ServerActionsTestOtherA-1604287769 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-c981ed4b-50f5-4504-b660-ed282a7ffe11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fec2913a-14ab-4aaa-ae15-26b3e02c9494', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:09:18 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-1cfc4cf4-5932-4b3f-831c-8b5b43476868 req-c8753b3c-4f24-4190-afb1-b4ae333a0521 tempest-ServerActionsTestOtherA-1604287769 None] attachment_update completed successfully. Sep 28 17:09:18 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-738b7ebd-d962-4659-94cb-8df746d517e5 tempest-GroupsV314Test-1343416303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-549a2864-2adb-4d00-8dc0-1b85f25d33a6" returned: 0 in 0.602s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-738b7ebd-d962-4659-94cb-8df746d517e5 tempest-GroupsV314Test-1343416303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-549a2864-2adb-4d00-8dc0-1b85f25d33a6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:18 devstack sudo[93463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-549a2864-2adb-4d00-8dc0-1b85f25d33a6 Sep 28 17:09:18 devstack sudo[93463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] Acquiring lock "cinder-afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] Acquiring lock "cinder-quobyte-8f7a6005-2bb8-4102-91a2-09620b1cde3f" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-quobyte-8f7a6005-2bb8-4102-91a2-09620b1cde3f" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] Acquiring lock "cinder-quobyte-afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-quobyte-afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:18 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] Deleting offline snapshot afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a of volume 8f7a6005-2bb8-4102-91a2-09620b1cde3f {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:09:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] snapshot_file for this snap is: volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:09:19 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2f1b8a-6f5a-42f4-bf56-12d45daa76c4]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:19 devstack sudo[93463]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-738b7ebd-d962-4659-94cb-8df746d517e5 tempest-GroupsV314Test-1343416303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-549a2864-2adb-4d00-8dc0-1b85f25d33a6" returned: 0 in 0.450s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:19 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-738b7ebd-d962-4659-94cb-8df746d517e5 tempest-GroupsV314Test-1343416303 None] Lock "cinder-quobyte-549a2864-2adb-4d00-8dc0-1b85f25d33a6" released by "delete_volume" :: held 1.137s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:19 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-738b7ebd-d962-4659-94cb-8df746d517e5 tempest-GroupsV314Test-1343416303 None] Created reservations ['82a00828-dd17-4f4f-ba06-e5ab40281435'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:19 devstack sudo[93467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a Sep 28 17:09:19 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:19 devstack cinder-volume[87061]: WARNING cinder.quota [None req-738b7ebd-d962-4659-94cb-8df746d517e5 tempest-GroupsV314Test-1343416303 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-947995824 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-947995824, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:09:19 devstack cinder-volume[87061]: WARNING cinder.quota [None req-738b7ebd-d962-4659-94cb-8df746d517e5 tempest-GroupsV314Test-1343416303 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-947995824 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-947995824, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:09:19 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-738b7ebd-d962-4659-94cb-8df746d517e5 tempest-GroupsV314Test-1343416303 None] Created reservations ['a31ae76b-db5a-4d4f-8cc1-07470d18e7fc', '8a884595-78b0-4527-97fb-68957aa3a43a', '45f9d7d3-b984-4424-af05-2090220416c9', '5c585b1c-e515-4174-92fb-bc06299b9e45'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-738b7ebd-d962-4659-94cb-8df746d517e5 tempest-GroupsV314Test-1343416303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-738b7ebd-d962-4659-94cb-8df746d517e5 tempest-GroupsV314Test-1343416303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-738b7ebd-d962-4659-94cb-8df746d517e5 tempest-GroupsV314Test-1343416303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-738b7ebd-d962-4659-94cb-8df746d517e5 tempest-GroupsV314Test-1343416303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-738b7ebd-d962-4659-94cb-8df746d517e5 tempest-GroupsV314Test-1343416303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.063s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-738b7ebd-d962-4659-94cb-8df746d517e5 tempest-GroupsV314Test-1343416303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:19 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:09:19 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:19 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a" returned: 0 in 0.810s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:09:19 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af98523-0254-4f38-b5a0-d52a06315409]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:20 devstack sudo[93590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 Sep 28 17:09:20 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:20 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-738b7ebd-d962-4659-94cb-8df746d517e5 tempest-GroupsV314Test-1343416303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.655s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:20 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-738b7ebd-d962-4659-94cb-8df746d517e5 tempest-GroupsV314Test-1343416303 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:20 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-738b7ebd-d962-4659-94cb-8df746d517e5 tempest-GroupsV314Test-1343416303 None] Delete group completed successfully. Sep 28 17:09:20 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41" returned: 0 in 0.793s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:20 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:09:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:20 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a Sep 28 17:09:20 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7d7c1647-059a-4f8e-b02f-5e55bdcee122 tempest-GroupsV314Test-1343416303 None] Acquiring lock "cinder-quobyte-58c4d574-3709-488d-afa6-40930fda7f74" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7d7c1647-059a-4f8e-b02f-5e55bdcee122 tempest-GroupsV314Test-1343416303 None] Lock "cinder-quobyte-58c4d574-3709-488d-afa6-40930fda7f74" acquired by "delete_volume" :: waited 0.024s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:21 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c99f55-8ea5-41c0-b674-074ec237372e]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7d7c1647-059a-4f8e-b02f-5e55bdcee122 tempest-GroupsV314Test-1343416303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:21 devstack sudo[93933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74 Sep 28 17:09:21 devstack sudo[93933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:21 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a" returned: 0 in 0.874s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:21 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a Sep 28 17:09:21 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:21 devstack sudo[93933]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7d7c1647-059a-4f8e-b02f-5e55bdcee122 tempest-GroupsV314Test-1343416303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74" returned: 0 in 0.696s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7d7c1647-059a-4f8e-b02f-5e55bdcee122 tempest-GroupsV314Test-1343416303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:22 devstack sudo[93953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74 Sep 28 17:09:22 devstack sudo[93953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:22 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a" returned: 0 in 0.407s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:22 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-quobyte-afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a" released by "_delete_snapshot" :: held 3.117s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:22 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-quobyte-8f7a6005-2bb8-4102-91a2-09620b1cde3f" released by "delete_snapshot" :: held 3.157s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:22 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] Created reservations ['fdc1aca4-4009-4a62-855b-8a3cffb2c780', '8df468c6-8c95-4f4e-916c-5abfb5979ee9', '6ccd11d1-f6c3-46ad-b856-37d3218eb06c', '80cf7c97-1a75-44d7-b42a-871d3bdf642a'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:22 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] Delete snapshot completed successfully. Sep 28 17:09:22 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eae5d987-c90d-4eb1-9e59-5d8e0a937d78 tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-afa63d8d-3ac3-4dd3-83bd-f98f6bdf462a-delete_snapshot" released by "delete_snapshot" :: held 3.433s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:22 devstack sudo[93953]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7d7c1647-059a-4f8e-b02f-5e55bdcee122 tempest-GroupsV314Test-1343416303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58c4d574-3709-488d-afa6-40930fda7f74" returned: 0 in 0.397s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:22 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7d7c1647-059a-4f8e-b02f-5e55bdcee122 tempest-GroupsV314Test-1343416303 None] Lock "cinder-quobyte-58c4d574-3709-488d-afa6-40930fda7f74" released by "delete_volume" :: held 1.213s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:22 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-7d7c1647-059a-4f8e-b02f-5e55bdcee122 tempest-GroupsV314Test-1343416303 None] Created reservations ['637983c1-e894-406c-8198-8d7278883539'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:22 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-7d7c1647-059a-4f8e-b02f-5e55bdcee122 tempest-GroupsV314Test-1343416303 None] Created reservations ['6bc756c5-2f70-4e72-91c3-ef9ac96d386c', '6d06202b-fae6-4d05-b925-8bfc5a75ce4c', 'cd3aa86b-9004-4cfe-886c-34e8a6e1ca47', '2b581301-9089-4823-a694-7494518eb5ab'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7d7c1647-059a-4f8e-b02f-5e55bdcee122 tempest-GroupsV314Test-1343416303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7d7c1647-059a-4f8e-b02f-5e55bdcee122 tempest-GroupsV314Test-1343416303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:22 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7d7c1647-059a-4f8e-b02f-5e55bdcee122 tempest-GroupsV314Test-1343416303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:22 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7d7c1647-059a-4f8e-b02f-5e55bdcee122 tempest-GroupsV314Test-1343416303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7d7c1647-059a-4f8e-b02f-5e55bdcee122 tempest-GroupsV314Test-1343416303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7d7c1647-059a-4f8e-b02f-5e55bdcee122 tempest-GroupsV314Test-1343416303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:22 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:09:22 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:23 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7d7c1647-059a-4f8e-b02f-5e55bdcee122 tempest-GroupsV314Test-1343416303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.496s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:23 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-7d7c1647-059a-4f8e-b02f-5e55bdcee122 tempest-GroupsV314Test-1343416303 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:23 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-7d7c1647-059a-4f8e-b02f-5e55bdcee122 tempest-GroupsV314Test-1343416303 None] Delete group completed successfully. Sep 28 17:09:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a64753fe-c741-48dd-9f92-12d1ccc296c7 tempest-SnapshotsActionsTest-1770180745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a64753fe-c741-48dd-9f92-12d1ccc296c7 tempest-SnapshotsActionsTest-1770180745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:23 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-a64753fe-c741-48dd-9f92-12d1ccc296c7 tempest-SnapshotsActionsTest-1770180745 None] Creating offline snapshot e99ef6f8-e101-41b9-ae09-4b1b0f4841b1 of volume 8f7a6005-2bb8-4102-91a2-09620b1cde3f {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:09:24 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d46567a-81be-4ffe-a75a-732d3981ed22]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a64753fe-c741-48dd-9f92-12d1ccc296c7 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:24 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 Sep 28 17:09:24 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:24 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a64753fe-c741-48dd-9f92-12d1ccc296c7 tempest-SnapshotsActionsTest-1770180745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41" returned: 0 in 0.893s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-a64753fe-c741-48dd-9f92-12d1ccc296c7 tempest-SnapshotsActionsTest-1770180745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:09:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a64753fe-c741-48dd-9f92-12d1ccc296c7 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.e99ef6f8-e101-41b9-ae09-4b1b0f4841b1 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:25 devstack sudo[93978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.e99ef6f8-e101-41b9-ae09-4b1b0f4841b1 1G Sep 28 17:09:25 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:26 devstack sudo[93978]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a64753fe-c741-48dd-9f92-12d1ccc296c7 tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.e99ef6f8-e101-41b9-ae09-4b1b0f4841b1 1G" returned: 0 in 1.071s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a64753fe-c741-48dd-9f92-12d1ccc296c7 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.e99ef6f8-e101-41b9-ae09-4b1b0f4841b1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:26 devstack sudo[93983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.e99ef6f8-e101-41b9-ae09-4b1b0f4841b1 Sep 28 17:09:26 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:26 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:INSERT=35,cinder:UPDATE=121,cinder:SELECT=117,cinder:DELETE=5 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:09:26 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d80fe480-07b1-4168-9b89-869fbc92ab04 tempest-GroupSnapshotsV319Test-1942316462 None] Group tempest-GroupSnapshotsV319Test-Group-486818579: creating Sep 28 17:09:26 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=116,cinder:UPDATE=108,cinder:INSERT=31,cinder:DELETE=8 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:09:26 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d80fe480-07b1-4168-9b89-869fbc92ab04 tempest-GroupSnapshotsV319Test-1942316462 None] Group tempest-GroupSnapshotsV319Test-Group-486818579: created successfully Sep 28 17:09:26 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d80fe480-07b1-4168-9b89-869fbc92ab04 tempest-GroupSnapshotsV319Test-1942316462 None] Create group completed successfully. Sep 28 17:09:26 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a64753fe-c741-48dd-9f92-12d1ccc296c7 tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.e99ef6f8-e101-41b9-ae09-4b1b0f4841b1" returned: 0 in 0.677s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:26 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-a64753fe-c741-48dd-9f92-12d1ccc296c7 tempest-SnapshotsActionsTest-1770180745 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.e99ef6f8-e101-41b9-ae09-4b1b0f4841b1 is being set with open permissions: ugo+rw Sep 28 17:09:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a64753fe-c741-48dd-9f92-12d1ccc296c7 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.e99ef6f8-e101-41b9-ae09-4b1b0f4841b1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:26 devstack sudo[93988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.e99ef6f8-e101-41b9-ae09-4b1b0f4841b1 Sep 28 17:09:26 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:27 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a64753fe-c741-48dd-9f92-12d1ccc296c7 tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.e99ef6f8-e101-41b9-ae09-4b1b0f4841b1" returned: 0 in 0.579s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a64753fe-c741-48dd-9f92-12d1ccc296c7 tempest-SnapshotsActionsTest-1770180745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.463s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:27 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a64753fe-c741-48dd-9f92-12d1ccc296c7 tempest-SnapshotsActionsTest-1770180745 None] Create snapshot completed successfully Sep 28 17:09:28 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] Acquiring lock "cinder-e99ef6f8-e101-41b9-ae09-4b1b0f4841b1-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:28 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Flow 'volume_create_manager' (be573b93-95a0-43b2-8dd1-d9bd811dd023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0655b7-8896-4a0f-8d74-215ffe57e368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0655b7-8896-4a0f-8d74-215ffe57e368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1519409763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e7442d7-42d2-46a6-a5eb-e59117377643,host='devstack@QuobyteHD#QuobyteHD',id=7e54f5c3-6a69-4e43-9650-228aa6770096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db77e20d0184a69b0a8e1c5cbd624a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:29Z,use_quota=True,user_id='f5963aea6e18430cb273fb4483adbf65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e93edee-fa6f-4f0b-b145-d399d7a53c79),volume_type_id=4e93edee-fa6f-4f0b-b145-d399d7a53c79)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7119e82d-486e-457e-a988-abe8e1f25d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7119e82d-486e-457e-a988-abe8e1f25d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (213fbf5c-8366-42fe-9d8e-4f656b5eeda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (213fbf5c-8366-42fe-9d8e-4f656b5eeda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e54f5c3-6a69-4e43-9650-228aa6770096', 'volume_name': 'volume-7e54f5c3-6a69-4e43-9650-228aa6770096', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f9d5c5-9058-49dc-a507-9f4711466df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f9d5c5-9058-49dc-a507-9f4711466df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3da5c876-2f24-4671-bf11-d2d7f6dc726a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:29 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Volume 7e54f5c3-6a69-4e43-9650-228aa6770096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e54f5c3-6a69-4e43-9650-228aa6770096', 'volume_size': 1} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7e7442d7-42d2-46a6-a5eb-e59117377643,created_at=2026-09-28T15:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1519409763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e7442d7-42d2-46a6-a5eb-e59117377643,host='devstack@QuobyteHD#QuobyteHD',id=7e54f5c3-6a69-4e43-9650-228aa6770096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db77e20d0184a69b0a8e1c5cbd624a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:29Z,use_quota=True,user_id='f5963aea6e18430cb273fb4483adbf65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e93edee-fa6f-4f0b-b145-d399d7a53c79),volume_type_id=4e93edee-fa6f-4f0b-b145-d399d7a53c79)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Creating volume 7e54f5c3-6a69-4e43-9650-228aa6770096 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:29 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-e99ef6f8-e101-41b9-ae09-4b1b0f4841b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.412s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] Acquiring lock "cinder-quobyte-8f7a6005-2bb8-4102-91a2-09620b1cde3f" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:29 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096 1073741824 Sep 28 17:09:29 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-quobyte-8f7a6005-2bb8-4102-91a2-09620b1cde3f" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] Acquiring lock "cinder-quobyte-e99ef6f8-e101-41b9-ae09-4b1b0f4841b1" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-quobyte-e99ef6f8-e101-41b9-ae09-4b1b0f4841b1" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] Deleting offline snapshot e99ef6f8-e101-41b9-ae09-4b1b0f4841b1 of volume 8f7a6005-2bb8-4102-91a2-09620b1cde3f {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] snapshot_file for this snap is: volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.e99ef6f8-e101-41b9-ae09-4b1b0f4841b1 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[438a4aca-2c40-465b-99df-5ff885f33088]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.e99ef6f8-e101-41b9-ae09-4b1b0f4841b1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:29 devstack sudo[93993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.e99ef6f8-e101-41b9-ae09-4b1b0f4841b1 Sep 28 17:09:29 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:30 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.e99ef6f8-e101-41b9-ae09-4b1b0f4841b1" returned: 0 in 0.733s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:30 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:09:30 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf901ac4-10c6-45f8-89ab-92e446a916d7]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:30 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096 1073741824" returned: 0 in 1.241s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:30 devstack sudo[94002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 Sep 28 17:09:30 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:30 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096 Sep 28 17:09:30 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:30 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41" returned: 0 in 0.655s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:30 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:09:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.e99ef6f8-e101-41b9-ae09-4b1b0f4841b1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:30 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.e99ef6f8-e101-41b9-ae09-4b1b0f4841b1 Sep 28 17:09:30 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:30 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096" returned: 0 in 0.410s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:30 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:30 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3da5c876-2f24-4671-bf11-d2d7f6dc726a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e54f5c3-6a69-4e43-9650-228aa6770096', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:30 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85dcb24c-08bd-4789-81b7-331ceb282bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:31 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Volume volume-7e54f5c3-6a69-4e43-9650-228aa6770096 (7e54f5c3-6a69-4e43-9650-228aa6770096): created successfully Sep 28 17:09:31 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85dcb24c-08bd-4789-81b7-331ceb282bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:31 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Flow 'volume_create_manager' (be573b93-95a0-43b2-8dd1-d9bd811dd023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:31 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-054f518c-572c-4de9-bf56-84d15e260f47 tempest-GroupSnapshotsV319Test-1942316462 None] Created volume successfully. Sep 28 17:09:31 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.e99ef6f8-e101-41b9-ae09-4b1b0f4841b1" returned: 0 in 0.598s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.e99ef6f8-e101-41b9-ae09-4b1b0f4841b1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:31 devstack sudo[94016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.e99ef6f8-e101-41b9-ae09-4b1b0f4841b1 Sep 28 17:09:31 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:31 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.e99ef6f8-e101-41b9-ae09-4b1b0f4841b1" returned: 0 in 0.378s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-quobyte-e99ef6f8-e101-41b9-ae09-4b1b0f4841b1" released by "_delete_snapshot" :: held 2.562s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-quobyte-8f7a6005-2bb8-4102-91a2-09620b1cde3f" released by "delete_snapshot" :: held 2.613s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:31 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-1e55ca02-c49a-4538-8c89-452e62c9d743 tempest-GroupSnapshotsV319Test-1942316462 None] GroupSnapshot dfdea802-0f20-4897-b416-f9455094e888: creating. Sep 28 17:09:31 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1e55ca02-c49a-4538-8c89-452e62c9d743 tempest-GroupSnapshotsV319Test-1942316462 None] Group snapshot dfdea802-0f20-4897-b416-f9455094e888: creating. {{(pid=87061) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:09:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1e55ca02-c49a-4538-8c89-452e62c9d743 tempest-GroupSnapshotsV319Test-1942316462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1e55ca02-c49a-4538-8c89-452e62c9d743 tempest-GroupSnapshotsV319Test-1942316462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-1e55ca02-c49a-4538-8c89-452e62c9d743 tempest-GroupSnapshotsV319Test-1942316462 None] Creating offline snapshot a5d71e77-fa31-4670-bf1f-7dd5a014c8d7 of volume 7e54f5c3-6a69-4e43-9650-228aa6770096 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:09:32 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] Created reservations ['315d458a-ecaf-4ef3-89e7-19977ad90aba', 'a5ddc363-1aa9-4fbe-a30c-d5898d7a392f', '13c340e3-ab22-473e-a1eb-f7cb714dc715', 'cff7829a-b1d1-4c9d-a308-6cd5d753942d'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:32 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fd6fe5-6ea9-451b-accc-21c852461d08]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1e55ca02-c49a-4538-8c89-452e62c9d743 tempest-GroupSnapshotsV319Test-1942316462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:32 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] Delete snapshot completed successfully. Sep 28 17:09:32 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-957249cc-d93b-41d9-8242-757c8e4347fa tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-e99ef6f8-e101-41b9-ae09-4b1b0f4841b1-delete_snapshot" released by "delete_snapshot" :: held 2.969s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:32 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096 Sep 28 17:09:32 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:32 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1e55ca02-c49a-4538-8c89-452e62c9d743 tempest-GroupSnapshotsV319Test-1942316462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096" returned: 0 in 0.562s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1e55ca02-c49a-4538-8c89-452e62c9d743 tempest-GroupSnapshotsV319Test-1942316462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.a5d71e77-fa31-4670-bf1f-7dd5a014c8d7 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:32 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.a5d71e77-fa31-4670-bf1f-7dd5a014c8d7 1G Sep 28 17:09:32 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-abe1755d-b5b8-4d87-bf4d-026613d02973 tempest-SnapshotsActionsTest-1770180745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:33 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1e55ca02-c49a-4538-8c89-452e62c9d743 tempest-GroupSnapshotsV319Test-1942316462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.a5d71e77-fa31-4670-bf1f-7dd5a014c8d7 1G" returned: 0 in 0.660s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1e55ca02-c49a-4538-8c89-452e62c9d743 tempest-GroupSnapshotsV319Test-1942316462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e54f5c3-6a69-4e43-9650-228aa6770096 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.a5d71e77-fa31-4670-bf1f-7dd5a014c8d7 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:33 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e54f5c3-6a69-4e43-9650-228aa6770096 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.a5d71e77-fa31-4670-bf1f-7dd5a014c8d7 Sep 28 17:09:33 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:33 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1e55ca02-c49a-4538-8c89-452e62c9d743 tempest-GroupSnapshotsV319Test-1942316462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e54f5c3-6a69-4e43-9650-228aa6770096 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.a5d71e77-fa31-4670-bf1f-7dd5a014c8d7" returned: 0 in 0.432s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:33 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-1e55ca02-c49a-4538-8c89-452e62c9d743 tempest-GroupSnapshotsV319Test-1942316462 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.a5d71e77-fa31-4670-bf1f-7dd5a014c8d7 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:09:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1e55ca02-c49a-4538-8c89-452e62c9d743 tempest-GroupSnapshotsV319Test-1942316462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.a5d71e77-fa31-4670-bf1f-7dd5a014c8d7 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:33 devstack sudo[94037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.a5d71e77-fa31-4670-bf1f-7dd5a014c8d7 Sep 28 17:09:33 devstack sudo[94037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:34 devstack sudo[94037]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1e55ca02-c49a-4538-8c89-452e62c9d743 tempest-GroupSnapshotsV319Test-1942316462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.a5d71e77-fa31-4670-bf1f-7dd5a014c8d7" returned: 0 in 0.313s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1e55ca02-c49a-4538-8c89-452e62c9d743 tempest-GroupSnapshotsV319Test-1942316462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:34 devstack sudo[94040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.info Sep 28 17:09:34 devstack sudo[94040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:34 devstack sudo[94040]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1e55ca02-c49a-4538-8c89-452e62c9d743 tempest-GroupSnapshotsV319Test-1942316462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.info" returned: 0 in 0.303s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:34 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-1e55ca02-c49a-4538-8c89-452e62c9d743 tempest-GroupSnapshotsV319Test-1942316462 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:09:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1e55ca02-c49a-4538-8c89-452e62c9d743 tempest-GroupSnapshotsV319Test-1942316462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:34 devstack sudo[94043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.info Sep 28 17:09:34 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:34 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1e55ca02-c49a-4538-8c89-452e62c9d743 tempest-GroupSnapshotsV319Test-1942316462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.info" returned: 0 in 0.285s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1e55ca02-c49a-4538-8c89-452e62c9d743 tempest-GroupSnapshotsV319Test-1942316462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.692s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-abe1755d-b5b8-4d87-bf4d-026613d02973 tempest-SnapshotsActionsTest-1770180745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.827s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-abe1755d-b5b8-4d87-bf4d-026613d02973 tempest-SnapshotsActionsTest-1770180745 None] Creating offline snapshot 508f476c-a2a4-4192-8661-07c6cf514a81 of volume 8f7a6005-2bb8-4102-91a2-09620b1cde3f {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:09:34 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fbf319-7fac-4f0c-bc68-010b995025ca]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-abe1755d-b5b8-4d87-bf4d-026613d02973 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:34 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-1e55ca02-c49a-4538-8c89-452e62c9d743 tempest-GroupSnapshotsV319Test-1942316462 None] group_snapshot dfdea802-0f20-4897-b416-f9455094e888: created successfully Sep 28 17:09:34 devstack sudo[94046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 Sep 28 17:09:34 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:35 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-abe1755d-b5b8-4d87-bf4d-026613d02973 tempest-SnapshotsActionsTest-1770180745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41" returned: 0 in 0.684s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-abe1755d-b5b8-4d87-bf4d-026613d02973 tempest-SnapshotsActionsTest-1770180745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:09:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-abe1755d-b5b8-4d87-bf4d-026613d02973 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.508f476c-a2a4-4192-8661-07c6cf514a81 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:35 devstack sudo[94051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.508f476c-a2a4-4192-8661-07c6cf514a81 1G Sep 28 17:09:35 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:35 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Flow 'volume_create_manager' (4e6dcd7e-e1a1-4478-ac0f-83a5040ae699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2fa942-aeaa-43b7-a0e4-4ccf32019242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2fa942-aeaa-43b7-a0e4-4ccf32019242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-249748832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86cdbfc0-c79f-496b-941b-8d637eec5e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='157d82e180564f2d9cd098ae339d9b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:36Z,use_quota=True,user_id='334773f4f8764e8388393e16c3445d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f291da-a701-4f31-aa56-5f4041985159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f291da-a701-4f31-aa56-5f4041985159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b26545-f9e7-4b1a-86bf-bd6f5f9e1f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b26545-f9e7-4b1a-86bf-bd6f5f9e1f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86cdbfc0-c79f-496b-941b-8d637eec5e0b', 'volume_name': 'volume-86cdbfc0-c79f-496b-941b-8d637eec5e0b', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7f8f71-3700-466c-976a-7c323d3bf25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7f8f71-3700-466c-976a-7c323d3bf25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b0fb49-8c28-4b09-ac74-a0c20888e474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:35 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Volume 86cdbfc0-c79f-496b-941b-8d637eec5e0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86cdbfc0-c79f-496b-941b-8d637eec5e0b', 'volume_size': 1} Sep 28 17:09:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:35 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] group_snapshot dfdea802-0f20-4897-b416-f9455094e888: deleting Sep 28 17:09:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] group_snapshot dfdea802-0f20-4897-b416-f9455094e888: deleting {{(pid=87061) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:09:35 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] Acquiring lock "cinder-quobyte-7e54f5c3-6a69-4e43-9650-228aa6770096" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] Lock "cinder-quobyte-7e54f5c3-6a69-4e43-9650-228aa6770096" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] Acquiring lock "cinder-quobyte-a5d71e77-fa31-4670-bf1f-7dd5a014c8d7" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] Lock "cinder-quobyte-a5d71e77-fa31-4670-bf1f-7dd5a014c8d7" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] Deleting offline snapshot a5d71e77-fa31-4670-bf1f-7dd5a014c8d7 of volume 7e54f5c3-6a69-4e43-9650-228aa6770096 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:09:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] snapshot_file for this snap is: volume-7e54f5c3-6a69-4e43-9650-228aa6770096.a5d71e77-fa31-4670-bf1f-7dd5a014c8d7 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:09:36 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc6b45a-9c6c-4ad9-addd-e0676678ecd5]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.a5d71e77-fa31-4670-bf1f-7dd5a014c8d7 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:36 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-abe1755d-b5b8-4d87-bf4d-026613d02973 tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.508f476c-a2a4-4192-8661-07c6cf514a81 1G" returned: 0 in 0.775s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-abe1755d-b5b8-4d87-bf4d-026613d02973 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.508f476c-a2a4-4192-8661-07c6cf514a81 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:36 devstack sudo[94057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.a5d71e77-fa31-4670-bf1f-7dd5a014c8d7 Sep 28 17:09:36 devstack sudo[94057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:36 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.508f476c-a2a4-4192-8661-07c6cf514a81 Sep 28 17:09:36 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:36 devstack sudo[94057]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.a5d71e77-fa31-4670-bf1f-7dd5a014c8d7" returned: 0 in 0.563s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e54f5c3-6a69-4e43-9650-228aa6770096(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:09:36 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-abe1755d-b5b8-4d87-bf4d-026613d02973 tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.508f476c-a2a4-4192-8661-07c6cf514a81" returned: 0 in 0.460s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:36 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-abe1755d-b5b8-4d87-bf4d-026613d02973 tempest-SnapshotsActionsTest-1770180745 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.508f476c-a2a4-4192-8661-07c6cf514a81 is being set with open permissions: ugo+rw Sep 28 17:09:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-abe1755d-b5b8-4d87-bf4d-026613d02973 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.508f476c-a2a4-4192-8661-07c6cf514a81 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:36 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5184106e-02ae-49ef-950a-05c394aa8fd4]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:36 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.508f476c-a2a4-4192-8661-07c6cf514a81 Sep 28 17:09:36 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:36 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096 Sep 28 17:09:36 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:37 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-abe1755d-b5b8-4d87-bf4d-026613d02973 tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.508f476c-a2a4-4192-8661-07c6cf514a81" returned: 0 in 0.339s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-abe1755d-b5b8-4d87-bf4d-026613d02973 tempest-SnapshotsActionsTest-1770180745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.404s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.275s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-249748832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86cdbfc0-c79f-496b-941b-8d637eec5e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='157d82e180564f2d9cd098ae339d9b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:36Z,use_quota=True,user_id='334773f4f8764e8388393e16c3445d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Creating volume 86cdbfc0-c79f-496b-941b-8d637eec5e0b {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:37 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:09:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86cdbfc0-c79f-496b-941b-8d637eec5e0b 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:37 devstack sudo[94076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86cdbfc0-c79f-496b-941b-8d637eec5e0b 1073741824 Sep 28 17:09:37 devstack sudo[94076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:37 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-abe1755d-b5b8-4d87-bf4d-026613d02973 tempest-SnapshotsActionsTest-1770180745 None] Create snapshot completed successfully Sep 28 17:09:37 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096" returned: 0 in 0.493s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.a5d71e77-fa31-4670-bf1f-7dd5a014c8d7 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:37 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.a5d71e77-fa31-4670-bf1f-7dd5a014c8d7 Sep 28 17:09:37 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:37 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.a5d71e77-fa31-4670-bf1f-7dd5a014c8d7" returned: 0 in 0.473s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.a5d71e77-fa31-4670-bf1f-7dd5a014c8d7 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:37 devstack sudo[94088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.a5d71e77-fa31-4670-bf1f-7dd5a014c8d7 Sep 28 17:09:37 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:37 devstack sudo[94076]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86cdbfc0-c79f-496b-941b-8d637eec5e0b 1073741824" returned: 0 in 0.653s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86cdbfc0-c79f-496b-941b-8d637eec5e0b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:37 devstack sudo[94090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86cdbfc0-c79f-496b-941b-8d637eec5e0b Sep 28 17:09:37 devstack sudo[94090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:38 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096.a5d71e77-fa31-4670-bf1f-7dd5a014c8d7" returned: 0 in 0.355s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] Lock "cinder-quobyte-a5d71e77-fa31-4670-bf1f-7dd5a014c8d7" released by "_delete_snapshot" :: held 2.062s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] Lock "cinder-quobyte-7e54f5c3-6a69-4e43-9650-228aa6770096" released by "delete_snapshot" :: held 2.107s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:38 devstack sudo[94090]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86cdbfc0-c79f-496b-941b-8d637eec5e0b" returned: 0 in 0.378s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b0fb49-8c28-4b09-ac74-a0c20888e474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86cdbfc0-c79f-496b-941b-8d637eec5e0b', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19aa8a31-a663-4e0e-8c1c-3f4e465cfc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:38 devstack cinder-volume[87061]: WARNING cinder.quota [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-758212841 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-758212841, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:09:38 devstack cinder-volume[87061]: WARNING cinder.quota [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-758212841 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-758212841, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:09:38 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Volume volume-86cdbfc0-c79f-496b-941b-8d637eec5e0b (86cdbfc0-c79f-496b-941b-8d637eec5e0b): created successfully Sep 28 17:09:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19aa8a31-a663-4e0e-8c1c-3f4e465cfc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Flow 'volume_create_manager' (4e6dcd7e-e1a1-4478-ac0f-83a5040ae699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:38 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] Created reservations ['05df4a1b-b51c-4aad-bc80-a817b165d8e7', 'b1fd204f-15e1-4933-8a20-a7f81c590812', 'aefab7f4-34c5-4d7b-a3fe-f514a31920c1', '6c47538a-9779-4af0-beca-77b8ef5df87c'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:38 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-58e58e32-abc8-44a6-bd37-f4ac8933fe43 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Created volume successfully. Sep 28 17:09:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] Acquiring lock "cinder-508f476c-a2a4-4192-8661-07c6cf514a81-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-508f476c-a2a4-4192-8661-07c6cf514a81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] Acquiring lock "cinder-quobyte-8f7a6005-2bb8-4102-91a2-09620b1cde3f" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:38 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-27a16097-ad64-4df0-92cf-2abf72ed2775 tempest-GroupSnapshotsV319Test-1942316462 None] group_snapshot dfdea802-0f20-4897-b416-f9455094e888: deleted successfully Sep 28 17:09:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-quobyte-8f7a6005-2bb8-4102-91a2-09620b1cde3f" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] Acquiring lock "cinder-quobyte-508f476c-a2a4-4192-8661-07c6cf514a81" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-quobyte-508f476c-a2a4-4192-8661-07c6cf514a81" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] Deleting offline snapshot 508f476c-a2a4-4192-8661-07c6cf514a81 of volume 8f7a6005-2bb8-4102-91a2-09620b1cde3f {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:09:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] snapshot_file for this snap is: volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.508f476c-a2a4-4192-8661-07c6cf514a81 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:09:38 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[331ca9a0-33c9-499b-8249-89f1eb18e313]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.508f476c-a2a4-4192-8661-07c6cf514a81 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:38 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.508f476c-a2a4-4192-8661-07c6cf514a81 Sep 28 17:09:38 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:39 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.508f476c-a2a4-4192-8661-07c6cf514a81" returned: 0 in 0.489s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:09:39 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb856e71-f6e1-41ca-8442-c1740b710bf6]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:39 devstack sudo[94099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 Sep 28 17:09:39 devstack sudo[94099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:39 devstack sudo[94099]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41" returned: 0 in 0.578s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:09:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.508f476c-a2a4-4192-8661-07c6cf514a81 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:39 devstack sudo[94128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.508f476c-a2a4-4192-8661-07c6cf514a81 Sep 28 17:09:39 devstack sudo[94128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a1c659b9-5ddf-4a62-9516-95f4dd82a7e0 tempest-GroupSnapshotsV319Test-1942316462 None] Acquiring lock "cinder-quobyte-7e54f5c3-6a69-4e43-9650-228aa6770096" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a1c659b9-5ddf-4a62-9516-95f4dd82a7e0 tempest-GroupSnapshotsV319Test-1942316462 None] Lock "cinder-quobyte-7e54f5c3-6a69-4e43-9650-228aa6770096" acquired by "delete_volume" :: waited 0.039s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:39 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d4e72c-32e2-4c24-a953-e4fe022f1755]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a1c659b9-5ddf-4a62-9516-95f4dd82a7e0 tempest-GroupSnapshotsV319Test-1942316462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:40 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096 Sep 28 17:09:40 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f72faf54-e08f-47d6-a69f-8b573f0035a8 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Acquiring lock "cinder-86cdbfc0-c79f-496b-941b-8d637eec5e0b-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f72faf54-e08f-47d6-a69f-8b573f0035a8 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Lock "cinder-86cdbfc0-c79f-496b-941b-8d637eec5e0b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:40 devstack sudo[94128]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.508f476c-a2a4-4192-8661-07c6cf514a81" returned: 0 in 0.744s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.508f476c-a2a4-4192-8661-07c6cf514a81 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:40 devstack sudo[94138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.508f476c-a2a4-4192-8661-07c6cf514a81 Sep 28 17:09:40 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f72faf54-e08f-47d6-a69f-8b573f0035a8 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Acquiring lock "cinder-quobyte-86cdbfc0-c79f-496b-941b-8d637eec5e0b" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f72faf54-e08f-47d6-a69f-8b573f0035a8 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Lock "cinder-quobyte-86cdbfc0-c79f-496b-941b-8d637eec5e0b" acquired by "delete_volume" :: waited 0.043s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:40 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[4165a2d6-b4ac-4600-9419-f363adf6befd]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f72faf54-e08f-47d6-a69f-8b573f0035a8 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86cdbfc0-c79f-496b-941b-8d637eec5e0b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:40 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a1c659b9-5ddf-4a62-9516-95f4dd82a7e0 tempest-GroupSnapshotsV319Test-1942316462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096" returned: 0 in 0.652s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a1c659b9-5ddf-4a62-9516-95f4dd82a7e0 tempest-GroupSnapshotsV319Test-1942316462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:40 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096 Sep 28 17:09:40 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:40 devstack sudo[94142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86cdbfc0-c79f-496b-941b-8d637eec5e0b Sep 28 17:09:40 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:40 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.508f476c-a2a4-4192-8661-07c6cf514a81" returned: 0 in 0.491s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-quobyte-508f476c-a2a4-4192-8661-07c6cf514a81" released by "_delete_snapshot" :: held 2.463s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-quobyte-8f7a6005-2bb8-4102-91a2-09620b1cde3f" released by "delete_snapshot" :: held 2.492s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:41 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a1c659b9-5ddf-4a62-9516-95f4dd82a7e0 tempest-GroupSnapshotsV319Test-1942316462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e54f5c3-6a69-4e43-9650-228aa6770096" returned: 0 in 0.472s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a1c659b9-5ddf-4a62-9516-95f4dd82a7e0 tempest-GroupSnapshotsV319Test-1942316462 None] Lock "cinder-quobyte-7e54f5c3-6a69-4e43-9650-228aa6770096" released by "delete_volume" :: held 1.267s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:41 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] Created reservations ['4554df02-4f12-48ce-911f-5e7b3be1ae08', 'b779faf2-4d49-4e05-b842-6f43522d06f2', '974ae936-a752-48da-a75f-da8d5b92cbd7', 'b26fe9d6-9b36-4ca0-8b56-61417d9cf373'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:41 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f72faf54-e08f-47d6-a69f-8b573f0035a8 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86cdbfc0-c79f-496b-941b-8d637eec5e0b" returned: 0 in 0.689s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f72faf54-e08f-47d6-a69f-8b573f0035a8 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86cdbfc0-c79f-496b-941b-8d637eec5e0b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:41 devstack sudo[94161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86cdbfc0-c79f-496b-941b-8d637eec5e0b Sep 28 17:09:41 devstack sudo[94161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:41 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-a1c659b9-5ddf-4a62-9516-95f4dd82a7e0 tempest-GroupSnapshotsV319Test-1942316462 None] Created reservations ['4907bf8e-c27e-406c-9bd8-f6894683bfe0'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:41 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] Delete snapshot completed successfully. Sep 28 17:09:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5aae3bb8-8236-45e8-a675-d319d5ff6080 tempest-SnapshotsActionsTest-597953477 None] Lock "cinder-508f476c-a2a4-4192-8661-07c6cf514a81-delete_snapshot" released by "delete_snapshot" :: held 2.949s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:41 devstack cinder-volume[87061]: WARNING cinder.quota [None req-a1c659b9-5ddf-4a62-9516-95f4dd82a7e0 tempest-GroupSnapshotsV319Test-1942316462 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-758212841 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-758212841, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:09:41 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-a1c659b9-5ddf-4a62-9516-95f4dd82a7e0 tempest-GroupSnapshotsV319Test-1942316462 None] Created reservations ['596a8aab-c543-4c0e-914c-5f310e9dc1c4', '278e3940-fb37-4828-b6a4-9ebb5db73715', 'f5d5a42f-035a-4ed2-b7c9-c37beaa0e31c', 'c895b9ff-783c-402f-b2c9-8e45c1495e83'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a1c659b9-5ddf-4a62-9516-95f4dd82a7e0 tempest-GroupSnapshotsV319Test-1942316462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a1c659b9-5ddf-4a62-9516-95f4dd82a7e0 tempest-GroupSnapshotsV319Test-1942316462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a1c659b9-5ddf-4a62-9516-95f4dd82a7e0 tempest-GroupSnapshotsV319Test-1942316462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a1c659b9-5ddf-4a62-9516-95f4dd82a7e0 tempest-GroupSnapshotsV319Test-1942316462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a1c659b9-5ddf-4a62-9516-95f4dd82a7e0 tempest-GroupSnapshotsV319Test-1942316462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a1c659b9-5ddf-4a62-9516-95f4dd82a7e0 tempest-GroupSnapshotsV319Test-1942316462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:41 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:09:41 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:41 devstack sudo[94161]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f72faf54-e08f-47d6-a69f-8b573f0035a8 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86cdbfc0-c79f-496b-941b-8d637eec5e0b" returned: 0 in 0.476s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f72faf54-e08f-47d6-a69f-8b573f0035a8 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Lock "cinder-quobyte-86cdbfc0-c79f-496b-941b-8d637eec5e0b" released by "delete_volume" :: held 1.266s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:41 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-f72faf54-e08f-47d6-a69f-8b573f0035a8 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Created reservations ['3783509d-bdda-43ba-adf1-5e851e88ee2d', 'd900e32f-aeba-4453-8d4c-c8878edf1f41', 'd58a0fcc-28b6-4429-ba75-8c6723c789f2', '036c61ea-d497-4e0b-9833-08afabf6d916'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f72faf54-e08f-47d6-a69f-8b573f0035a8 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f72faf54-e08f-47d6-a69f-8b573f0035a8 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f72faf54-e08f-47d6-a69f-8b573f0035a8 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f72faf54-e08f-47d6-a69f-8b573f0035a8 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f72faf54-e08f-47d6-a69f-8b573f0035a8 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f72faf54-e08f-47d6-a69f-8b573f0035a8 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:42 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a1c659b9-5ddf-4a62-9516-95f4dd82a7e0 tempest-GroupSnapshotsV319Test-1942316462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.437s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:42 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-a1c659b9-5ddf-4a62-9516-95f4dd82a7e0 tempest-GroupSnapshotsV319Test-1942316462 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:42 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a1c659b9-5ddf-4a62-9516-95f4dd82a7e0 tempest-GroupSnapshotsV319Test-1942316462 None] Delete group completed successfully. Sep 28 17:09:42 devstack sudo[94168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:09:42 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1cab2f28-357c-4823-919c-9fc717e232e0 tempest-SnapshotsActionsTest-1770180745 None] Acquiring lock "cinder-97e954a1-93f9-4583-be30-a33fd8cdff41-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1cab2f28-357c-4823-919c-9fc717e232e0 tempest-SnapshotsActionsTest-1770180745 None] Lock "cinder-97e954a1-93f9-4583-be30-a33fd8cdff41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1cab2f28-357c-4823-919c-9fc717e232e0 tempest-SnapshotsActionsTest-1770180745 None] Acquiring lock "cinder-quobyte-8f7a6005-2bb8-4102-91a2-09620b1cde3f" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:42 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1cab2f28-357c-4823-919c-9fc717e232e0 tempest-SnapshotsActionsTest-1770180745 None] Lock "cinder-quobyte-8f7a6005-2bb8-4102-91a2-09620b1cde3f" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1cab2f28-357c-4823-919c-9fc717e232e0 tempest-SnapshotsActionsTest-1770180745 None] Acquiring lock "cinder-quobyte-97e954a1-93f9-4583-be30-a33fd8cdff41" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f72faf54-e08f-47d6-a69f-8b573f0035a8 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.439s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:42 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-f72faf54-e08f-47d6-a69f-8b573f0035a8 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:42 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-f72faf54-e08f-47d6-a69f-8b573f0035a8 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Deleted volume successfully. Sep 28 17:09:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1cab2f28-357c-4823-919c-9fc717e232e0 tempest-SnapshotsActionsTest-1770180745 None] Lock "cinder-quobyte-97e954a1-93f9-4583-be30-a33fd8cdff41" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-1cab2f28-357c-4823-919c-9fc717e232e0 tempest-SnapshotsActionsTest-1770180745 None] Deleting offline snapshot 97e954a1-93f9-4583-be30-a33fd8cdff41 of volume 8f7a6005-2bb8-4102-91a2-09620b1cde3f {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:09:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-1cab2f28-357c-4823-919c-9fc717e232e0 tempest-SnapshotsActionsTest-1770180745 None] snapshot_file for this snap is: volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:09:42 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2036332-bded-4399-bd61-5c6232499280]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1cab2f28-357c-4823-919c-9fc717e232e0 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f72faf54-e08f-47d6-a69f-8b573f0035a8 tempest-VolumeQuotasNegativeTestJSON-1976377924 None] Lock "cinder-86cdbfc0-c79f-496b-941b-8d637eec5e0b-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:42 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 Sep 28 17:09:42 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:43 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1cab2f28-357c-4823-919c-9fc717e232e0 tempest-SnapshotsActionsTest-1770180745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41" returned: 0 in 0.619s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:43 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-1cab2f28-357c-4823-919c-9fc717e232e0 tempest-SnapshotsActionsTest-1770180745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:09:43 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0dc42e-78a2-48c7-b513-2d8828da0b27]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1cab2f28-357c-4823-919c-9fc717e232e0 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:43 devstack sudo[94180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f Sep 28 17:09:43 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:43 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1cab2f28-357c-4823-919c-9fc717e232e0 tempest-SnapshotsActionsTest-1770180745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f" returned: 0 in 0.596s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1cab2f28-357c-4823-919c-9fc717e232e0 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:43 devstack sudo[94186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 Sep 28 17:09:43 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:44 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1cab2f28-357c-4823-919c-9fc717e232e0 tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41" returned: 0 in 0.626s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1cab2f28-357c-4823-919c-9fc717e232e0 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:44 devstack sudo[94205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41 Sep 28 17:09:44 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:44 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1cab2f28-357c-4823-919c-9fc717e232e0 tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f.97e954a1-93f9-4583-be30-a33fd8cdff41" returned: 0 in 0.487s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1cab2f28-357c-4823-919c-9fc717e232e0 tempest-SnapshotsActionsTest-1770180745 None] Lock "cinder-quobyte-97e954a1-93f9-4583-be30-a33fd8cdff41" released by "_delete_snapshot" :: held 2.502s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1cab2f28-357c-4823-919c-9fc717e232e0 tempest-SnapshotsActionsTest-1770180745 None] Lock "cinder-quobyte-8f7a6005-2bb8-4102-91a2-09620b1cde3f" released by "delete_snapshot" :: held 2.535s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:45 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-1cab2f28-357c-4823-919c-9fc717e232e0 tempest-SnapshotsActionsTest-1770180745 None] Created reservations ['4cb367ab-7f52-41d3-9ace-02ec6f7af763', 'a55710ea-e409-4b30-ab7f-ea328b236115', '2c23c40d-de4e-45f9-8bf5-74fbee64772d', '3d8e4c8d-3f06-4b91-b20f-abd625245251'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:45 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-1cab2f28-357c-4823-919c-9fc717e232e0 tempest-SnapshotsActionsTest-1770180745 None] Delete snapshot completed successfully. Sep 28 17:09:45 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1cab2f28-357c-4823-919c-9fc717e232e0 tempest-SnapshotsActionsTest-1770180745 None] Lock "cinder-97e954a1-93f9-4583-be30-a33fd8cdff41-delete_snapshot" released by "delete_snapshot" :: held 2.737s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:45 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9ad67835-a83f-490d-9b12-d74191956ce7 tempest-SnapshotsActionsTest-1770180745 None] Acquiring lock "cinder-8f7a6005-2bb8-4102-91a2-09620b1cde3f-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:45 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9ad67835-a83f-490d-9b12-d74191956ce7 tempest-SnapshotsActionsTest-1770180745 None] Lock "cinder-8f7a6005-2bb8-4102-91a2-09620b1cde3f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:45 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9ad67835-a83f-490d-9b12-d74191956ce7 tempest-SnapshotsActionsTest-1770180745 None] Acquiring lock "cinder-quobyte-8f7a6005-2bb8-4102-91a2-09620b1cde3f" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:45 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9ad67835-a83f-490d-9b12-d74191956ce7 tempest-SnapshotsActionsTest-1770180745 None] Lock "cinder-quobyte-8f7a6005-2bb8-4102-91a2-09620b1cde3f" acquired by "delete_volume" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:46 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2d695f-36f0-43f0-b3b8-363e7d1e0678]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ad67835-a83f-490d-9b12-d74191956ce7 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:46 devstack sudo[94208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f Sep 28 17:09:46 devstack sudo[94208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:46 devstack sudo[94208]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ad67835-a83f-490d-9b12-d74191956ce7 tempest-SnapshotsActionsTest-1770180745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f" returned: 0 in 0.508s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ad67835-a83f-490d-9b12-d74191956ce7 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:46 devstack sudo[94213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f Sep 28 17:09:46 devstack sudo[94213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:46 devstack sudo[94213]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ad67835-a83f-490d-9b12-d74191956ce7 tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f7a6005-2bb8-4102-91a2-09620b1cde3f" returned: 0 in 0.347s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:46 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9ad67835-a83f-490d-9b12-d74191956ce7 tempest-SnapshotsActionsTest-1770180745 None] Lock "cinder-quobyte-8f7a6005-2bb8-4102-91a2-09620b1cde3f" released by "delete_volume" :: held 1.018s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:47 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-9ad67835-a83f-490d-9b12-d74191956ce7 tempest-SnapshotsActionsTest-1770180745 None] Created reservations ['174d5640-c65f-4028-8c0a-e981e427afc1', 'a7561f29-bef1-4f1f-9fa5-94fff44d8e9b', 'ed341cd6-4077-4279-92e8-14e6ed836977', '3aa2921d-df2b-481e-8556-7b36d8d9fed6'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9ad67835-a83f-490d-9b12-d74191956ce7 tempest-SnapshotsActionsTest-1770180745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9ad67835-a83f-490d-9b12-d74191956ce7 tempest-SnapshotsActionsTest-1770180745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9ad67835-a83f-490d-9b12-d74191956ce7 tempest-SnapshotsActionsTest-1770180745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9ad67835-a83f-490d-9b12-d74191956ce7 tempest-SnapshotsActionsTest-1770180745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9ad67835-a83f-490d-9b12-d74191956ce7 tempest-SnapshotsActionsTest-1770180745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ad67835-a83f-490d-9b12-d74191956ce7 tempest-SnapshotsActionsTest-1770180745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:47 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:09:47 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:47 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ad67835-a83f-490d-9b12-d74191956ce7 tempest-SnapshotsActionsTest-1770180745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.295s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:47 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-9ad67835-a83f-490d-9b12-d74191956ce7 tempest-SnapshotsActionsTest-1770180745 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:47 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-9ad67835-a83f-490d-9b12-d74191956ce7 tempest-SnapshotsActionsTest-1770180745 None] Deleted volume successfully. Sep 28 17:09:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9ad67835-a83f-490d-9b12-d74191956ce7 tempest-SnapshotsActionsTest-1770180745 None] Lock "cinder-8f7a6005-2bb8-4102-91a2-09620b1cde3f-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:57 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=61,cinder:UPDATE=55,cinder:INSERT=14,cinder:DELETE=1 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:09:57 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:UPDATE=65,cinder:SELECT=47,cinder:DELETE=5,cinder:INSERT=18 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:10:02 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Flow 'volume_create_manager' (7777a3d5-0bb7-4327-864d-c2eef51c1e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52ca8a2e-26e6-4b62-a0ca-bb3368328889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52ca8a2e-26e6-4b62-a0ca-bb3368328889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-446333809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d431f932-190c-4a0b-8ef7-0c52ff7ef8bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26bd98bbdc0f4dea8375a196d632510e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:03Z,use_quota=True,user_id='46f5b50a12be4d36bf41273d0778156f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b45fee1-74f0-4ffb-9e0f-8fe92935f139),volume_type_id=0b45fee1-74f0-4ffb-9e0f-8fe92935f139)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15561a53-4c19-429a-9c77-4c9ae7fb560e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15561a53-4c19-429a-9c77-4c9ae7fb560e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1624a0a8-f8ce-4003-a3ce-6c2e909ccdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1624a0a8-f8ce-4003-a3ce-6c2e909ccdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd431f932-190c-4a0b-8ef7-0c52ff7ef8bc', 'volume_name': 'volume-d431f932-190c-4a0b-8ef7-0c52ff7ef8bc', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13fa2453-ef03-440c-a806-93a95d9fc4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13fa2453-ef03-440c-a806-93a95d9fc4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a969970-00b9-4727-8a29-c97578790121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:02 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Volume d431f932-190c-4a0b-8ef7-0c52ff7ef8bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d431f932-190c-4a0b-8ef7-0c52ff7ef8bc', 'volume_size': 1} Sep 28 17:10:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-446333809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d431f932-190c-4a0b-8ef7-0c52ff7ef8bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26bd98bbdc0f4dea8375a196d632510e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:03Z,use_quota=True,user_id='46f5b50a12be4d36bf41273d0778156f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b45fee1-74f0-4ffb-9e0f-8fe92935f139),volume_type_id=0b45fee1-74f0-4ffb-9e0f-8fe92935f139)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Creating volume d431f932-190c-4a0b-8ef7-0c52ff7ef8bc {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:02 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:10:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d431f932-190c-4a0b-8ef7-0c52ff7ef8bc 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:02 devstack sudo[94265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d431f932-190c-4a0b-8ef7-0c52ff7ef8bc 1073741824 Sep 28 17:10:02 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:03 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d431f932-190c-4a0b-8ef7-0c52ff7ef8bc 1073741824" returned: 0 in 0.593s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d431f932-190c-4a0b-8ef7-0c52ff7ef8bc {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:03 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d431f932-190c-4a0b-8ef7-0c52ff7ef8bc Sep 28 17:10:03 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:03 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d431f932-190c-4a0b-8ef7-0c52ff7ef8bc" returned: 0 in 0.369s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a969970-00b9-4727-8a29-c97578790121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d431f932-190c-4a0b-8ef7-0c52ff7ef8bc', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861c7013-e0e0-4594-8474-35f27722a16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:03 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Volume volume-d431f932-190c-4a0b-8ef7-0c52ff7ef8bc (d431f932-190c-4a0b-8ef7-0c52ff7ef8bc): created successfully Sep 28 17:10:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861c7013-e0e0-4594-8474-35f27722a16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Flow 'volume_create_manager' (7777a3d5-0bb7-4327-864d-c2eef51c1e0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:03 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-b6231337-96aa-4521-bfe5-63edfd84f8bc tempest-VolumeTypesAccessTest-816251020 None] Created volume successfully. Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e3238a11-09fb-41e6-b6fe-b0cf0660b1fb tempest-VolumeTypesAccessTest-816251020 None] Acquiring lock "cinder-d431f932-190c-4a0b-8ef7-0c52ff7ef8bc-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e3238a11-09fb-41e6-b6fe-b0cf0660b1fb tempest-VolumeTypesAccessTest-816251020 None] Lock "cinder-d431f932-190c-4a0b-8ef7-0c52ff7ef8bc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e3238a11-09fb-41e6-b6fe-b0cf0660b1fb tempest-VolumeTypesAccessTest-816251020 None] Acquiring lock "cinder-quobyte-d431f932-190c-4a0b-8ef7-0c52ff7ef8bc" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e3238a11-09fb-41e6-b6fe-b0cf0660b1fb tempest-VolumeTypesAccessTest-816251020 None] Lock "cinder-quobyte-d431f932-190c-4a0b-8ef7-0c52ff7ef8bc" acquired by "delete_volume" :: waited 0.025s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc4d9e0-a40a-489f-b600-97fe2c78fa38]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e3238a11-09fb-41e6-b6fe-b0cf0660b1fb tempest-VolumeTypesAccessTest-816251020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d431f932-190c-4a0b-8ef7-0c52ff7ef8bc {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:05 devstack sudo[94276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d431f932-190c-4a0b-8ef7-0c52ff7ef8bc Sep 28 17:10:05 devstack sudo[94276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:05 devstack sudo[94276]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Flow 'volume_create_manager' (91506da5-3cc1-4dfd-8580-77950d47d10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3fd47e4-27f7-4f94-a707-12bedd4d3d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e3238a11-09fb-41e6-b6fe-b0cf0660b1fb tempest-VolumeTypesAccessTest-816251020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d431f932-190c-4a0b-8ef7-0c52ff7ef8bc" returned: 0 in 0.538s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e3238a11-09fb-41e6-b6fe-b0cf0660b1fb tempest-VolumeTypesAccessTest-816251020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d431f932-190c-4a0b-8ef7-0c52ff7ef8bc {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3fd47e4-27f7-4f94-a707-12bedd4d3d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1685050820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b4830a-5beb-4915-b006-a347850db8f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='220b4dfcdf334acaa74b7957b886b9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:06Z,use_quota=True,user_id='360e372ba1cc48aa86abafd121874016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(286c65fe-ddc2-4c6d-aeb3-6e77beeb6d7f),volume_type_id=286c65fe-ddc2-4c6d-aeb3-6e77beeb6d7f)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:05 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d431f932-190c-4a0b-8ef7-0c52ff7ef8bc Sep 28 17:10:05 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ea6c64-0cdc-4eb5-bbfa-1da39f222f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ea6c64-0cdc-4eb5-bbfa-1da39f222f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c68e530-9e21-4268-9f33-9e6e66d047d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c68e530-9e21-4268-9f33-9e6e66d047d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b4830a-5beb-4915-b006-a347850db8f0', 'volume_name': 'volume-72b4830a-5beb-4915-b006-a347850db8f0', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (128191d6-40cf-4b97-b595-ec825333d98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (128191d6-40cf-4b97-b595-ec825333d98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665484f8-1498-46ca-9cd8-1573bdf5a964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:05 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Volume 72b4830a-5beb-4915-b006-a347850db8f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b4830a-5beb-4915-b006-a347850db8f0', 'volume_size': 1} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1685050820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b4830a-5beb-4915-b006-a347850db8f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='220b4dfcdf334acaa74b7957b886b9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:06Z,use_quota=True,user_id='360e372ba1cc48aa86abafd121874016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(286c65fe-ddc2-4c6d-aeb3-6e77beeb6d7f),volume_type_id=286c65fe-ddc2-4c6d-aeb3-6e77beeb6d7f)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Creating volume 72b4830a-5beb-4915-b006-a347850db8f0 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:05 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:10:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-72b4830a-5beb-4915-b006-a347850db8f0 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:05 devstack sudo[94286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-72b4830a-5beb-4915-b006-a347850db8f0 1073741824 Sep 28 17:10:05 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:06 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e3238a11-09fb-41e6-b6fe-b0cf0660b1fb tempest-VolumeTypesAccessTest-816251020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d431f932-190c-4a0b-8ef7-0c52ff7ef8bc" returned: 0 in 0.372s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e3238a11-09fb-41e6-b6fe-b0cf0660b1fb tempest-VolumeTypesAccessTest-816251020 None] Lock "cinder-quobyte-d431f932-190c-4a0b-8ef7-0c52ff7ef8bc" released by "delete_volume" :: held 0.967s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:06 devstack cinder-volume[87061]: WARNING cinder.quota [None req-e3238a11-09fb-41e6-b6fe-b0cf0660b1fb tempest-VolumeTypesAccessTest-816251020 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1743364561 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1743364561, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:10:06 devstack cinder-volume[87061]: WARNING cinder.quota [None req-e3238a11-09fb-41e6-b6fe-b0cf0660b1fb tempest-VolumeTypesAccessTest-816251020 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1743364561 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1743364561, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:10:06 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-e3238a11-09fb-41e6-b6fe-b0cf0660b1fb tempest-VolumeTypesAccessTest-816251020 None] Created reservations ['4a2aa9e9-0a26-4448-9ac0-0e8aa5ffb3d4', 'fafa2082-8e97-41a2-b992-e8a0ffdbb206', '67e7c6a0-b7d4-4923-b32b-2d26017f6fb4', '25b8d4cf-84d1-4671-bca1-ead3565c4914'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e3238a11-09fb-41e6-b6fe-b0cf0660b1fb tempest-VolumeTypesAccessTest-816251020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e3238a11-09fb-41e6-b6fe-b0cf0660b1fb tempest-VolumeTypesAccessTest-816251020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e3238a11-09fb-41e6-b6fe-b0cf0660b1fb tempest-VolumeTypesAccessTest-816251020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e3238a11-09fb-41e6-b6fe-b0cf0660b1fb tempest-VolumeTypesAccessTest-816251020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e3238a11-09fb-41e6-b6fe-b0cf0660b1fb tempest-VolumeTypesAccessTest-816251020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e3238a11-09fb-41e6-b6fe-b0cf0660b1fb tempest-VolumeTypesAccessTest-816251020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:06 devstack sudo[94293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:10:06 devstack sudo[94293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:06 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-72b4830a-5beb-4915-b006-a347850db8f0 1073741824" returned: 0 in 0.774s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-72b4830a-5beb-4915-b006-a347850db8f0 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:06 devstack sudo[94296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-72b4830a-5beb-4915-b006-a347850db8f0 Sep 28 17:10:06 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:10:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:06 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:10:06 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:06 devstack sudo[94293]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e3238a11-09fb-41e6-b6fe-b0cf0660b1fb tempest-VolumeTypesAccessTest-816251020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.553s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:06 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-e3238a11-09fb-41e6-b6fe-b0cf0660b1fb tempest-VolumeTypesAccessTest-816251020 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:06 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e3238a11-09fb-41e6-b6fe-b0cf0660b1fb tempest-VolumeTypesAccessTest-816251020 None] Deleted volume successfully. Sep 28 17:10:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e3238a11-09fb-41e6-b6fe-b0cf0660b1fb tempest-VolumeTypesAccessTest-816251020 None] Lock "cinder-d431f932-190c-4a0b-8ef7-0c52ff7ef8bc-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:07 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-72b4830a-5beb-4915-b006-a347850db8f0" returned: 0 in 0.652s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665484f8-1498-46ca-9cd8-1573bdf5a964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b4830a-5beb-4915-b006-a347850db8f0', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a78b7f1-7d54-4b98-9e80-c6029cbf34e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:07 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.592s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:10:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:10:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:10:07 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Volume volume-72b4830a-5beb-4915-b006-a347850db8f0 (72b4830a-5beb-4915-b006-a347850db8f0): created successfully Sep 28 17:10:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a78b7f1-7d54-4b98-9e80-c6029cbf34e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Flow 'volume_create_manager' (91506da5-3cc1-4dfd-8580-77950d47d10d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:07 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-12ea455c-519b-4b00-a1a8-355430103ec5 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Created volume successfully. Sep 28 17:10:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d41e7ff4-07ea-4990-b208-c9ed06e83a01 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d41e7ff4-07ea-4990-b208-c9ed06e83a01 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d41e7ff4-07ea-4990-b208-c9ed06e83a01 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d41e7ff4-07ea-4990-b208-c9ed06e83a01 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d41e7ff4-07ea-4990-b208-c9ed06e83a01 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d41e7ff4-07ea-4990-b208-c9ed06e83a01 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:08 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:10:08 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:08 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d41e7ff4-07ea-4990-b208-c9ed06e83a01 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.420s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:08 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-d41e7ff4-07ea-4990-b208-c9ed06e83a01 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:08 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d41e7ff4-07ea-4990-b208-c9ed06e83a01 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Retype volume completed successfully. Sep 28 17:10:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-73e199c0-a675-48ac-a3de-d6225b2070f4 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Acquiring lock "cinder-72b4830a-5beb-4915-b006-a347850db8f0-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-73e199c0-a675-48ac-a3de-d6225b2070f4 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Lock "cinder-72b4830a-5beb-4915-b006-a347850db8f0-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-73e199c0-a675-48ac-a3de-d6225b2070f4 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Acquiring lock "cinder-quobyte-72b4830a-5beb-4915-b006-a347850db8f0" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-73e199c0-a675-48ac-a3de-d6225b2070f4 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Lock "cinder-quobyte-72b4830a-5beb-4915-b006-a347850db8f0" acquired by "delete_volume" :: waited 0.019s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:10 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e7bc12-ce61-4ab4-b00a-576ccc88f6a5]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-73e199c0-a675-48ac-a3de-d6225b2070f4 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-72b4830a-5beb-4915-b006-a347850db8f0 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:10 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-72b4830a-5beb-4915-b006-a347850db8f0 Sep 28 17:10:10 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:10 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-7ae74795-aa98-485d-92f8-24417b74ba14 req-b948c69f-c5a5-4605-8268-fb5334c4bca7 tempest-ServerActionsTestOtherA-1604287769 None] Terminate volume connection completed successfully. Sep 28 17:10:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-7ae74795-aa98-485d-92f8-24417b74ba14 req-b948c69f-c5a5-4605-8268-fb5334c4bca7 tempest-ServerActionsTestOtherA-1604287769 None] Deleting attachment fec2913a-14ab-4aaa-ae15-26b3e02c9494. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:10:10 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-73e199c0-a675-48ac-a3de-d6225b2070f4 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-72b4830a-5beb-4915-b006-a347850db8f0" returned: 0 in 0.539s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-73e199c0-a675-48ac-a3de-d6225b2070f4 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-72b4830a-5beb-4915-b006-a347850db8f0 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:10 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-72b4830a-5beb-4915-b006-a347850db8f0 Sep 28 17:10:10 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-7ae74795-aa98-485d-92f8-24417b74ba14 req-9b04c7b1-42c2-4002-9889-ad9bbb16cc78 tempest-ServerActionsTestOtherA-1604287769 None] Acquiring lock "cinder-c981ed4b-50f5-4504-b660-ed282a7ffe11-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-7ae74795-aa98-485d-92f8-24417b74ba14 req-9b04c7b1-42c2-4002-9889-ad9bbb16cc78 tempest-ServerActionsTestOtherA-1604287769 None] Lock "cinder-c981ed4b-50f5-4504-b660-ed282a7ffe11-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-7ae74795-aa98-485d-92f8-24417b74ba14 req-9b04c7b1-42c2-4002-9889-ad9bbb16cc78 tempest-ServerActionsTestOtherA-1604287769 None] Acquiring lock "cinder-quobyte-c981ed4b-50f5-4504-b660-ed282a7ffe11" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-7ae74795-aa98-485d-92f8-24417b74ba14 req-9b04c7b1-42c2-4002-9889-ad9bbb16cc78 tempest-ServerActionsTestOtherA-1604287769 None] Lock "cinder-quobyte-c981ed4b-50f5-4504-b660-ed282a7ffe11" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:10 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f74621b-b410-4aa2-8272-d32dd2e58f58]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-7ae74795-aa98-485d-92f8-24417b74ba14 req-9b04c7b1-42c2-4002-9889-ad9bbb16cc78 tempest-ServerActionsTestOtherA-1604287769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c981ed4b-50f5-4504-b660-ed282a7ffe11 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:10 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-73e199c0-a675-48ac-a3de-d6225b2070f4 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-72b4830a-5beb-4915-b006-a347850db8f0" returned: 0 in 0.398s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-73e199c0-a675-48ac-a3de-d6225b2070f4 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Lock "cinder-quobyte-72b4830a-5beb-4915-b006-a347850db8f0" released by "delete_volume" :: held 1.014s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:11 devstack cinder-volume[87061]: WARNING cinder.quota [None req-73e199c0-a675-48ac-a3de-d6225b2070f4 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:10:11 devstack cinder-volume[87061]: WARNING cinder.quota [None req-73e199c0-a675-48ac-a3de-d6225b2070f4 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:10:11 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-73e199c0-a675-48ac-a3de-d6225b2070f4 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Created reservations ['0fb12385-328b-474a-a32c-c4a5f2c6c140', '595b7747-2e15-45f5-b0e9-52337369d884', '8b33b170-44e8-42a8-91c4-56d98123650a', '30508827-a2a5-43bd-bb3f-18cd6c27bfbb'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:11 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c981ed4b-50f5-4504-b660-ed282a7ffe11 Sep 28 17:10:11 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-73e199c0-a675-48ac-a3de-d6225b2070f4 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-73e199c0-a675-48ac-a3de-d6225b2070f4 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-73e199c0-a675-48ac-a3de-d6225b2070f4 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-73e199c0-a675-48ac-a3de-d6225b2070f4 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-73e199c0-a675-48ac-a3de-d6225b2070f4 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-73e199c0-a675-48ac-a3de-d6225b2070f4 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:11 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:10:11 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:11 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-7ae74795-aa98-485d-92f8-24417b74ba14 req-9b04c7b1-42c2-4002-9889-ad9bbb16cc78 tempest-ServerActionsTestOtherA-1604287769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c981ed4b-50f5-4504-b660-ed282a7ffe11" returned: 0 in 0.684s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-7ae74795-aa98-485d-92f8-24417b74ba14 req-9b04c7b1-42c2-4002-9889-ad9bbb16cc78 tempest-ServerActionsTestOtherA-1604287769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c981ed4b-50f5-4504-b660-ed282a7ffe11 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:11 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c981ed4b-50f5-4504-b660-ed282a7ffe11 Sep 28 17:10:11 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:11 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-73e199c0-a675-48ac-a3de-d6225b2070f4 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.499s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:11 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-73e199c0-a675-48ac-a3de-d6225b2070f4 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:11 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-73e199c0-a675-48ac-a3de-d6225b2070f4 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Deleted volume successfully. Sep 28 17:10:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-73e199c0-a675-48ac-a3de-d6225b2070f4 tempest-VolumeRetypeWithoutMigrationTest-344675594 None] Lock "cinder-72b4830a-5beb-4915-b006-a347850db8f0-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:12 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-7ae74795-aa98-485d-92f8-24417b74ba14 req-9b04c7b1-42c2-4002-9889-ad9bbb16cc78 tempest-ServerActionsTestOtherA-1604287769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c981ed4b-50f5-4504-b660-ed282a7ffe11" returned: 0 in 0.453s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d061f93d-5f7f-4213-9a7d-7a194fffbff1 tempest-ServerActionsTestOtherA-1604287769 None] Acquiring lock "cinder-e50c351d-26a5-4f3e-ad62-e81f9b2c0154-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-7ae74795-aa98-485d-92f8-24417b74ba14 req-9b04c7b1-42c2-4002-9889-ad9bbb16cc78 tempest-ServerActionsTestOtherA-1604287769 None] Lock "cinder-quobyte-c981ed4b-50f5-4504-b660-ed282a7ffe11" released by "delete_volume" :: held 1.243s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d061f93d-5f7f-4213-9a7d-7a194fffbff1 tempest-ServerActionsTestOtherA-1604287769 None] Lock "cinder-e50c351d-26a5-4f3e-ad62-e81f9b2c0154-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d061f93d-5f7f-4213-9a7d-7a194fffbff1 tempest-ServerActionsTestOtherA-1604287769 None] Acquiring lock "cinder-quobyte-e50c351d-26a5-4f3e-ad62-e81f9b2c0154" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:12 devstack cinder-volume[87061]: DEBUG cinder.quota [req-7ae74795-aa98-485d-92f8-24417b74ba14 req-9b04c7b1-42c2-4002-9889-ad9bbb16cc78 tempest-ServerActionsTestOtherA-1604287769 None] Created reservations ['81586def-b2cb-410c-a7bc-4ccc83de238a', '5f6561c4-3d9d-4205-8a99-4b28f8dd69cb', '7721bb96-4055-47ec-9672-a3c238297242', 'df2fddeb-351d-445f-820e-488fb2f1da91'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d061f93d-5f7f-4213-9a7d-7a194fffbff1 tempest-ServerActionsTestOtherA-1604287769 None] Lock "cinder-quobyte-e50c351d-26a5-4f3e-ad62-e81f9b2c0154" acquired by "delete_volume" :: waited 0.059s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:12 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[97667968-543a-461d-9273-d7fcf8f6e995]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d061f93d-5f7f-4213-9a7d-7a194fffbff1 tempest-ServerActionsTestOtherA-1604287769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e50c351d-26a5-4f3e-ad62-e81f9b2c0154 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-7ae74795-aa98-485d-92f8-24417b74ba14 req-9b04c7b1-42c2-4002-9889-ad9bbb16cc78 tempest-ServerActionsTestOtherA-1604287769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-7ae74795-aa98-485d-92f8-24417b74ba14 req-9b04c7b1-42c2-4002-9889-ad9bbb16cc78 tempest-ServerActionsTestOtherA-1604287769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [req-7ae74795-aa98-485d-92f8-24417b74ba14 req-9b04c7b1-42c2-4002-9889-ad9bbb16cc78 tempest-ServerActionsTestOtherA-1604287769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [req-7ae74795-aa98-485d-92f8-24417b74ba14 req-9b04c7b1-42c2-4002-9889-ad9bbb16cc78 tempest-ServerActionsTestOtherA-1604287769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-7ae74795-aa98-485d-92f8-24417b74ba14 req-9b04c7b1-42c2-4002-9889-ad9bbb16cc78 tempest-ServerActionsTestOtherA-1604287769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-7ae74795-aa98-485d-92f8-24417b74ba14 req-9b04c7b1-42c2-4002-9889-ad9bbb16cc78 tempest-ServerActionsTestOtherA-1604287769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:12 devstack sudo[94357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:10:12 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:12 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e50c351d-26a5-4f3e-ad62-e81f9b2c0154 Sep 28 17:10:12 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:12 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-7ae74795-aa98-485d-92f8-24417b74ba14 req-9b04c7b1-42c2-4002-9889-ad9bbb16cc78 tempest-ServerActionsTestOtherA-1604287769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.389s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:12 devstack cinder-volume[87061]: DEBUG cinder.manager [req-7ae74795-aa98-485d-92f8-24417b74ba14 req-9b04c7b1-42c2-4002-9889-ad9bbb16cc78 tempest-ServerActionsTestOtherA-1604287769 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:12 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-7ae74795-aa98-485d-92f8-24417b74ba14 req-9b04c7b1-42c2-4002-9889-ad9bbb16cc78 tempest-ServerActionsTestOtherA-1604287769 None] Deleted volume successfully. Sep 28 17:10:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-7ae74795-aa98-485d-92f8-24417b74ba14 req-9b04c7b1-42c2-4002-9889-ad9bbb16cc78 tempest-ServerActionsTestOtherA-1604287769 None] Lock "cinder-c981ed4b-50f5-4504-b660-ed282a7ffe11-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:13 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d061f93d-5f7f-4213-9a7d-7a194fffbff1 tempest-ServerActionsTestOtherA-1604287769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e50c351d-26a5-4f3e-ad62-e81f9b2c0154" returned: 0 in 0.705s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d061f93d-5f7f-4213-9a7d-7a194fffbff1 tempest-ServerActionsTestOtherA-1604287769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e50c351d-26a5-4f3e-ad62-e81f9b2c0154 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:13 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e50c351d-26a5-4f3e-ad62-e81f9b2c0154 Sep 28 17:10:13 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:13 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d061f93d-5f7f-4213-9a7d-7a194fffbff1 tempest-ServerActionsTestOtherA-1604287769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e50c351d-26a5-4f3e-ad62-e81f9b2c0154" returned: 0 in 0.546s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d061f93d-5f7f-4213-9a7d-7a194fffbff1 tempest-ServerActionsTestOtherA-1604287769 None] Lock "cinder-quobyte-e50c351d-26a5-4f3e-ad62-e81f9b2c0154" released by "delete_volume" :: held 1.362s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:13 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-d061f93d-5f7f-4213-9a7d-7a194fffbff1 tempest-ServerActionsTestOtherA-1604287769 None] Created reservations ['0a8d40a9-51e2-4633-9219-cad2f24aaab5', '851659c1-cc3a-4014-b769-ec8a811b02f6', 'c49735d4-9721-4c2e-b88a-1a9c9b06a0e5', 'ae832015-b9a1-45a3-89f6-0fd5d0c4e0b3'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d061f93d-5f7f-4213-9a7d-7a194fffbff1 tempest-ServerActionsTestOtherA-1604287769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d061f93d-5f7f-4213-9a7d-7a194fffbff1 tempest-ServerActionsTestOtherA-1604287769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:13 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d061f93d-5f7f-4213-9a7d-7a194fffbff1 tempest-ServerActionsTestOtherA-1604287769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:13 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d061f93d-5f7f-4213-9a7d-7a194fffbff1 tempest-ServerActionsTestOtherA-1604287769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d061f93d-5f7f-4213-9a7d-7a194fffbff1 tempest-ServerActionsTestOtherA-1604287769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d061f93d-5f7f-4213-9a7d-7a194fffbff1 tempest-ServerActionsTestOtherA-1604287769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:13 devstack sudo[94376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:10:13 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:14 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d061f93d-5f7f-4213-9a7d-7a194fffbff1 tempest-ServerActionsTestOtherA-1604287769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.547s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:14 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-d061f93d-5f7f-4213-9a7d-7a194fffbff1 tempest-ServerActionsTestOtherA-1604287769 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:14 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d061f93d-5f7f-4213-9a7d-7a194fffbff1 tempest-ServerActionsTestOtherA-1604287769 None] Deleted volume successfully. Sep 28 17:10:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d061f93d-5f7f-4213-9a7d-7a194fffbff1 tempest-ServerActionsTestOtherA-1604287769 None] Lock "cinder-e50c351d-26a5-4f3e-ad62-e81f9b2c0154-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:23 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:UPDATE=44,cinder:SELECT=33,cinder:DELETE=4,cinder:INSERT=9 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:10:24 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=31,cinder:UPDATE=41,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:10:27 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:27 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Flow 'volume_create_manager' (d1cf55d3-1ed5-45d8-9fbe-26943e11d2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:27 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae971eae-bbf6-4b9d-9d7a-056d52888e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:27 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae971eae-bbf6-4b9d-9d7a-056d52888e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-307232989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f4e477-f125-4f9b-b581-c36b7bc8312e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470a971ffd0340c090d43a06921f3eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:27Z,use_quota=True,user_id='f63a4d7a65e34ada9900e9ce5952bd40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:27 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a592cf-7c0d-41e2-9e49-9c597ef1e02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:27 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a592cf-7c0d-41e2-9e49-9c597ef1e02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:27 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b66c6f-f3a9-4a99-bd24-a0eb18dfc0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:27 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b66c6f-f3a9-4a99-bd24-a0eb18dfc0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35f4e477-f125-4f9b-b581-c36b7bc8312e', 'volume_name': 'volume-35f4e477-f125-4f9b-b581-c36b7bc8312e', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:27 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9fc3ff-2dbe-4b0c-9a2a-b26ff7d00c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:27 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9fc3ff-2dbe-4b0c-9a2a-b26ff7d00c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:27 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f01a655-8389-432d-af15-cd28178cbda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:27 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Volume 35f4e477-f125-4f9b-b581-c36b7bc8312e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35f4e477-f125-4f9b-b581-c36b7bc8312e', 'volume_size': 1} Sep 28 17:10:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:27 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-307232989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f4e477-f125-4f9b-b581-c36b7bc8312e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470a971ffd0340c090d43a06921f3eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:27Z,use_quota=True,user_id='f63a4d7a65e34ada9900e9ce5952bd40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:27 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Creating volume 35f4e477-f125-4f9b-b581-c36b7bc8312e {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:27 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:27 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:27 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:27 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:10:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-35f4e477-f125-4f9b-b581-c36b7bc8312e 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:27 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-35f4e477-f125-4f9b-b581-c36b7bc8312e 1073741824 Sep 28 17:10:27 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:28 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-35f4e477-f125-4f9b-b581-c36b7bc8312e 1073741824" returned: 0 in 0.834s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-35f4e477-f125-4f9b-b581-c36b7bc8312e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:28 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-35f4e477-f125-4f9b-b581-c36b7bc8312e Sep 28 17:10:28 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:28 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-35f4e477-f125-4f9b-b581-c36b7bc8312e" returned: 0 in 0.315s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f01a655-8389-432d-af15-cd28178cbda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35f4e477-f125-4f9b-b581-c36b7bc8312e', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef6a16b8-7448-4619-ab5b-fce2a4b0878a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:28 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Volume volume-35f4e477-f125-4f9b-b581-c36b7bc8312e (35f4e477-f125-4f9b-b581-c36b7bc8312e): created successfully Sep 28 17:10:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef6a16b8-7448-4619-ab5b-fce2a4b0878a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Flow 'volume_create_manager' (d1cf55d3-1ed5-45d8-9fbe-26943e11d2ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:28 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-86ae3c4f-cfd2-4a30-abf8-0a5a1a57feee tempest-VolumesServicesTestJSON-2022575895 None] Created volume successfully. Sep 28 17:10:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-73902615-8a4b-42a7-aba4-9fb144679130 tempest-VolumesServicesTestJSON-2022575895 None] Acquiring lock "cinder-35f4e477-f125-4f9b-b581-c36b7bc8312e-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-73902615-8a4b-42a7-aba4-9fb144679130 tempest-VolumesServicesTestJSON-2022575895 None] Lock "cinder-35f4e477-f125-4f9b-b581-c36b7bc8312e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-73902615-8a4b-42a7-aba4-9fb144679130 tempest-VolumesServicesTestJSON-2022575895 None] Acquiring lock "cinder-quobyte-35f4e477-f125-4f9b-b581-c36b7bc8312e" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-73902615-8a4b-42a7-aba4-9fb144679130 tempest-VolumesServicesTestJSON-2022575895 None] Lock "cinder-quobyte-35f4e477-f125-4f9b-b581-c36b7bc8312e" acquired by "delete_volume" :: waited 0.028s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:29 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[da50bef6-5f03-4d06-9f39-2b4d5164016e]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-73902615-8a4b-42a7-aba4-9fb144679130 tempest-VolumesServicesTestJSON-2022575895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-35f4e477-f125-4f9b-b581-c36b7bc8312e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:29 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-35f4e477-f125-4f9b-b581-c36b7bc8312e Sep 28 17:10:29 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:30 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-73902615-8a4b-42a7-aba4-9fb144679130 tempest-VolumesServicesTestJSON-2022575895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-35f4e477-f125-4f9b-b581-c36b7bc8312e" returned: 0 in 0.527s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-73902615-8a4b-42a7-aba4-9fb144679130 tempest-VolumesServicesTestJSON-2022575895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-35f4e477-f125-4f9b-b581-c36b7bc8312e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:30 devstack sudo[94426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-35f4e477-f125-4f9b-b581-c36b7bc8312e Sep 28 17:10:30 devstack sudo[94426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:30 devstack sudo[94426]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-73902615-8a4b-42a7-aba4-9fb144679130 tempest-VolumesServicesTestJSON-2022575895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-35f4e477-f125-4f9b-b581-c36b7bc8312e" returned: 0 in 0.385s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-73902615-8a4b-42a7-aba4-9fb144679130 tempest-VolumesServicesTestJSON-2022575895 None] Lock "cinder-quobyte-35f4e477-f125-4f9b-b581-c36b7bc8312e" released by "delete_volume" :: held 0.975s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:30 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-73902615-8a4b-42a7-aba4-9fb144679130 tempest-VolumesServicesTestJSON-2022575895 None] Created reservations ['5200ed95-9505-4f66-9a1f-3edafdc2a7a6', '0a041e92-19c2-4516-84ba-e290ad64b5e6', 'e51a6613-f23d-4b81-9431-5990819103cf', '57d7dd41-b45f-400f-a7ae-ee6b45766d6d'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-73902615-8a4b-42a7-aba4-9fb144679130 tempest-VolumesServicesTestJSON-2022575895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-73902615-8a4b-42a7-aba4-9fb144679130 tempest-VolumesServicesTestJSON-2022575895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:30 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-73902615-8a4b-42a7-aba4-9fb144679130 tempest-VolumesServicesTestJSON-2022575895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:30 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-73902615-8a4b-42a7-aba4-9fb144679130 tempest-VolumesServicesTestJSON-2022575895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-73902615-8a4b-42a7-aba4-9fb144679130 tempest-VolumesServicesTestJSON-2022575895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-73902615-8a4b-42a7-aba4-9fb144679130 tempest-VolumesServicesTestJSON-2022575895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:30 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:10:30 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:31 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-73902615-8a4b-42a7-aba4-9fb144679130 tempest-VolumesServicesTestJSON-2022575895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.320s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:31 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-73902615-8a4b-42a7-aba4-9fb144679130 tempest-VolumesServicesTestJSON-2022575895 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:31 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-73902615-8a4b-42a7-aba4-9fb144679130 tempest-VolumesServicesTestJSON-2022575895 None] Deleted volume successfully. Sep 28 17:10:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-73902615-8a4b-42a7-aba4-9fb144679130 tempest-VolumesServicesTestJSON-2022575895 None] Lock "cinder-35f4e477-f125-4f9b-b581-c36b7bc8312e-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:34 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Flow 'volume_create_manager' (fb3480cd-4430-4ec9-bbed-44be4bf33193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4908ab1e-c93f-429e-8f0b-f76af597ab99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4908ab1e-c93f-429e-8f0b-f76af597ab99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-237211913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0289e613-7535-4e88-a8f4-83b5a0051ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d58ec6005fe4b22a556583d00ab3872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:35Z,use_quota=True,user_id='d8888b89e0524899ae9c640359335d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b16d8fa-4a80-4702-a16e-00b81b0ab5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b16d8fa-4a80-4702-a16e-00b81b0ab5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0d282b-d7b2-43e2-8cb9-d626f365b5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0d282b-d7b2-43e2-8cb9-d626f365b5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0289e613-7535-4e88-a8f4-83b5a0051ff9', 'volume_name': 'volume-0289e613-7535-4e88-a8f4-83b5a0051ff9', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f7b36d-cee3-4653-8023-8ffab6866061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f7b36d-cee3-4653-8023-8ffab6866061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd81bfb-fb84-46ff-a9d2-210a8e7c2d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:34 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Volume 0289e613-7535-4e88-a8f4-83b5a0051ff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0289e613-7535-4e88-a8f4-83b5a0051ff9', 'volume_size': 1} Sep 28 17:10:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-237211913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0289e613-7535-4e88-a8f4-83b5a0051ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d58ec6005fe4b22a556583d00ab3872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:35Z,use_quota=True,user_id='d8888b89e0524899ae9c640359335d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Creating volume 0289e613-7535-4e88-a8f4-83b5a0051ff9 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:34 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:10:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0289e613-7535-4e88-a8f4-83b5a0051ff9 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:34 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0289e613-7535-4e88-a8f4-83b5a0051ff9 1073741824 Sep 28 17:10:34 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:35 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0289e613-7535-4e88-a8f4-83b5a0051ff9 1073741824" returned: 0 in 0.608s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0289e613-7535-4e88-a8f4-83b5a0051ff9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:35 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0289e613-7535-4e88-a8f4-83b5a0051ff9 Sep 28 17:10:35 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:35 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0289e613-7535-4e88-a8f4-83b5a0051ff9" returned: 0 in 0.338s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd81bfb-fb84-46ff-a9d2-210a8e7c2d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0289e613-7535-4e88-a8f4-83b5a0051ff9', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7790c28-5935-4c91-b178-7cdd0fe7dc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:35 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Volume volume-0289e613-7535-4e88-a8f4-83b5a0051ff9 (0289e613-7535-4e88-a8f4-83b5a0051ff9): created successfully Sep 28 17:10:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7790c28-5935-4c91-b178-7cdd0fe7dc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Flow 'volume_create_manager' (fb3480cd-4430-4ec9-bbed-44be4bf33193) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:35 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-7b668c99-b37a-44cb-8f1d-009598c5c627 tempest-VolumeQuotasAdminTestJSON-185353216 None] Created volume successfully. Sep 28 17:10:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a5cf6d69-d24f-4d06-801d-491bdb838925 tempest-VolumeQuotasAdminTestJSON-185353216 None] Acquiring lock "cinder-0289e613-7535-4e88-a8f4-83b5a0051ff9-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a5cf6d69-d24f-4d06-801d-491bdb838925 tempest-VolumeQuotasAdminTestJSON-185353216 None] Lock "cinder-0289e613-7535-4e88-a8f4-83b5a0051ff9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a5cf6d69-d24f-4d06-801d-491bdb838925 tempest-VolumeQuotasAdminTestJSON-185353216 None] Acquiring lock "cinder-quobyte-0289e613-7535-4e88-a8f4-83b5a0051ff9" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a5cf6d69-d24f-4d06-801d-491bdb838925 tempest-VolumeQuotasAdminTestJSON-185353216 None] Lock "cinder-quobyte-0289e613-7535-4e88-a8f4-83b5a0051ff9" acquired by "delete_volume" :: waited 0.014s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:36 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b836083a-773f-40ef-8eab-1468e7d18530]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a5cf6d69-d24f-4d06-801d-491bdb838925 tempest-VolumeQuotasAdminTestJSON-185353216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0289e613-7535-4e88-a8f4-83b5a0051ff9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:37 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0289e613-7535-4e88-a8f4-83b5a0051ff9 Sep 28 17:10:37 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:37 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a5cf6d69-d24f-4d06-801d-491bdb838925 tempest-VolumeQuotasAdminTestJSON-185353216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0289e613-7535-4e88-a8f4-83b5a0051ff9" returned: 0 in 0.517s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a5cf6d69-d24f-4d06-801d-491bdb838925 tempest-VolumeQuotasAdminTestJSON-185353216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0289e613-7535-4e88-a8f4-83b5a0051ff9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:37 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0289e613-7535-4e88-a8f4-83b5a0051ff9 Sep 28 17:10:37 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:37 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a5cf6d69-d24f-4d06-801d-491bdb838925 tempest-VolumeQuotasAdminTestJSON-185353216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0289e613-7535-4e88-a8f4-83b5a0051ff9" returned: 0 in 0.389s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a5cf6d69-d24f-4d06-801d-491bdb838925 tempest-VolumeQuotasAdminTestJSON-185353216 None] Lock "cinder-quobyte-0289e613-7535-4e88-a8f4-83b5a0051ff9" released by "delete_volume" :: held 0.973s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:38 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-a5cf6d69-d24f-4d06-801d-491bdb838925 tempest-VolumeQuotasAdminTestJSON-185353216 None] Created reservations ['c4f95a05-1de5-4db3-b9cb-6fa59e1ce901', '0b5cff87-0f1e-4a30-b711-26f3009420c6', 'c4deabbf-963f-4faa-8305-201c8f86be2f', 'ed430717-d37d-4acd-b077-9c03c90d3386'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a5cf6d69-d24f-4d06-801d-491bdb838925 tempest-VolumeQuotasAdminTestJSON-185353216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a5cf6d69-d24f-4d06-801d-491bdb838925 tempest-VolumeQuotasAdminTestJSON-185353216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a5cf6d69-d24f-4d06-801d-491bdb838925 tempest-VolumeQuotasAdminTestJSON-185353216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a5cf6d69-d24f-4d06-801d-491bdb838925 tempest-VolumeQuotasAdminTestJSON-185353216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a5cf6d69-d24f-4d06-801d-491bdb838925 tempest-VolumeQuotasAdminTestJSON-185353216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a5cf6d69-d24f-4d06-801d-491bdb838925 tempest-VolumeQuotasAdminTestJSON-185353216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:38 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:10:38 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:38 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a5cf6d69-d24f-4d06-801d-491bdb838925 tempest-VolumeQuotasAdminTestJSON-185353216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.322s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:38 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-a5cf6d69-d24f-4d06-801d-491bdb838925 tempest-VolumeQuotasAdminTestJSON-185353216 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:38 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a5cf6d69-d24f-4d06-801d-491bdb838925 tempest-VolumeQuotasAdminTestJSON-185353216 None] Deleted volume successfully. Sep 28 17:10:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a5cf6d69-d24f-4d06-801d-491bdb838925 tempest-VolumeQuotasAdminTestJSON-185353216 None] Lock "cinder-0289e613-7535-4e88-a8f4-83b5a0051ff9-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Flow 'volume_create_manager' (01b33d5a-d77c-4d05-8580-f9224e036d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7829cb-ff32-4a85-ba02-3b13a9a56392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7829cb-ff32-4a85-ba02-3b13a9a56392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1355093567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b68912-4aca-458a-a8dd-f307ded55f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d58ec6005fe4b22a556583d00ab3872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:40Z,use_quota=True,user_id='d8888b89e0524899ae9c640359335d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46bba67-2ece-4798-8c96-250a4056884a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46bba67-2ece-4798-8c96-250a4056884a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfdfec80-c4a4-40e1-97d6-25b1f9546d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfdfec80-c4a4-40e1-97d6-25b1f9546d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49b68912-4aca-458a-a8dd-f307ded55f4c', 'volume_name': 'volume-49b68912-4aca-458a-a8dd-f307ded55f4c', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd92eb1f-f66e-4933-9f34-8eff7d9f4ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd92eb1f-f66e-4933-9f34-8eff7d9f4ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24e1d30d-5d00-44b8-a428-9318098c80d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:40 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Volume 49b68912-4aca-458a-a8dd-f307ded55f4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49b68912-4aca-458a-a8dd-f307ded55f4c', 'volume_size': 1} Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1355093567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b68912-4aca-458a-a8dd-f307ded55f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d58ec6005fe4b22a556583d00ab3872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:40Z,use_quota=True,user_id='d8888b89e0524899ae9c640359335d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Creating volume 49b68912-4aca-458a-a8dd-f307ded55f4c {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:40 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-49b68912-4aca-458a-a8dd-f307ded55f4c 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:40 devstack sudo[94453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-49b68912-4aca-458a-a8dd-f307ded55f4c 1073741824 Sep 28 17:10:40 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:40 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-49b68912-4aca-458a-a8dd-f307ded55f4c 1073741824" returned: 0 in 0.622s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-49b68912-4aca-458a-a8dd-f307ded55f4c {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:40 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-49b68912-4aca-458a-a8dd-f307ded55f4c Sep 28 17:10:40 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:41 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-49b68912-4aca-458a-a8dd-f307ded55f4c" returned: 0 in 0.380s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24e1d30d-5d00-44b8-a428-9318098c80d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49b68912-4aca-458a-a8dd-f307ded55f4c', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9bfc131-062b-4bb2-9c19-d887a5342b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:41 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Volume volume-49b68912-4aca-458a-a8dd-f307ded55f4c (49b68912-4aca-458a-a8dd-f307ded55f4c): created successfully Sep 28 17:10:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9bfc131-062b-4bb2-9c19-d887a5342b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Flow 'volume_create_manager' (01b33d5a-d77c-4d05-8580-f9224e036d3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:41 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-c63553a3-415d-4d24-9623-4a8cd26b87dd tempest-VolumeQuotasAdminTestJSON-185353216 None] Created volume successfully. Sep 28 17:10:43 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-4eafb729-e508-4cc8-b3fc-b072fda24ac2 tempest-VolumeQuotasAdminTestJSON-2050583307 None] Transfer volume completed successfully. Sep 28 17:10:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a11ca97f-60dd-4414-9c43-7f82eed75f9d tempest-VolumeQuotasAdminTestJSON-259078576 None] Acquiring lock "cinder-49b68912-4aca-458a-a8dd-f307ded55f4c-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a11ca97f-60dd-4414-9c43-7f82eed75f9d tempest-VolumeQuotasAdminTestJSON-259078576 None] Lock "cinder-49b68912-4aca-458a-a8dd-f307ded55f4c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a11ca97f-60dd-4414-9c43-7f82eed75f9d tempest-VolumeQuotasAdminTestJSON-259078576 None] Acquiring lock "cinder-quobyte-49b68912-4aca-458a-a8dd-f307ded55f4c" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a11ca97f-60dd-4414-9c43-7f82eed75f9d tempest-VolumeQuotasAdminTestJSON-259078576 None] Lock "cinder-quobyte-49b68912-4aca-458a-a8dd-f307ded55f4c" acquired by "delete_volume" :: waited 0.032s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:44 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9be8977-0434-4f6d-9af1-4ee0d3335ae3]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a11ca97f-60dd-4414-9c43-7f82eed75f9d tempest-VolumeQuotasAdminTestJSON-259078576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-49b68912-4aca-458a-a8dd-f307ded55f4c {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:44 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-49b68912-4aca-458a-a8dd-f307ded55f4c Sep 28 17:10:44 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:45 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a11ca97f-60dd-4414-9c43-7f82eed75f9d tempest-VolumeQuotasAdminTestJSON-259078576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-49b68912-4aca-458a-a8dd-f307ded55f4c" returned: 0 in 0.458s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a11ca97f-60dd-4414-9c43-7f82eed75f9d tempest-VolumeQuotasAdminTestJSON-259078576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-49b68912-4aca-458a-a8dd-f307ded55f4c {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:45 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-49b68912-4aca-458a-a8dd-f307ded55f4c Sep 28 17:10:45 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:45 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a11ca97f-60dd-4414-9c43-7f82eed75f9d tempest-VolumeQuotasAdminTestJSON-259078576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-49b68912-4aca-458a-a8dd-f307ded55f4c" returned: 0 in 0.395s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:45 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a11ca97f-60dd-4414-9c43-7f82eed75f9d tempest-VolumeQuotasAdminTestJSON-259078576 None] Lock "cinder-quobyte-49b68912-4aca-458a-a8dd-f307ded55f4c" released by "delete_volume" :: held 0.921s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:45 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-a11ca97f-60dd-4414-9c43-7f82eed75f9d tempest-VolumeQuotasAdminTestJSON-259078576 None] Created reservations ['b5ab0147-60f6-42ac-a6ef-a129e9ac9be4', '8c6138c6-6587-45eb-b3df-cb0def341cff', '8fa8fb4a-bade-4d27-b815-76da6a7feda5', '9401b795-fdd7-47ef-8f4c-6d525cddc5a6'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a11ca97f-60dd-4414-9c43-7f82eed75f9d tempest-VolumeQuotasAdminTestJSON-259078576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a11ca97f-60dd-4414-9c43-7f82eed75f9d tempest-VolumeQuotasAdminTestJSON-259078576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a11ca97f-60dd-4414-9c43-7f82eed75f9d tempest-VolumeQuotasAdminTestJSON-259078576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a11ca97f-60dd-4414-9c43-7f82eed75f9d tempest-VolumeQuotasAdminTestJSON-259078576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a11ca97f-60dd-4414-9c43-7f82eed75f9d tempest-VolumeQuotasAdminTestJSON-259078576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a11ca97f-60dd-4414-9c43-7f82eed75f9d tempest-VolumeQuotasAdminTestJSON-259078576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:45 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:10:45 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:46 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a11ca97f-60dd-4414-9c43-7f82eed75f9d tempest-VolumeQuotasAdminTestJSON-259078576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.364s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:46 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-a11ca97f-60dd-4414-9c43-7f82eed75f9d tempest-VolumeQuotasAdminTestJSON-259078576 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:46 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a11ca97f-60dd-4414-9c43-7f82eed75f9d tempest-VolumeQuotasAdminTestJSON-259078576 None] Deleted volume successfully. Sep 28 17:10:46 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a11ca97f-60dd-4414-9c43-7f82eed75f9d tempest-VolumeQuotasAdminTestJSON-259078576 None] Lock "cinder-49b68912-4aca-458a-a8dd-f307ded55f4c-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:55 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=20,cinder:UPDATE=30,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:10:55 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Flow 'volume_create_manager' (dff86ab7-708b-4487-b82a-2baeab016255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f244c4-9317-4a9b-9389-f41a06f1b6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f244c4-9317-4a9b-9389-f41a06f1b6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1097640656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91aca460-282f-4650-b1f4-701576fb8fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24fc1a7d580a4aa78de3a2202654ff51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:56Z,use_quota=True,user_id='2aa4425bc03148ffa84b0aed803452ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9a8e54-012e-4b00-a68e-11d301c1390c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9a8e54-012e-4b00-a68e-11d301c1390c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c91889e5-ba20-4a13-b38c-81da25d22d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c91889e5-ba20-4a13-b38c-81da25d22d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91aca460-282f-4650-b1f4-701576fb8fb1', 'volume_name': 'volume-91aca460-282f-4650-b1f4-701576fb8fb1', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96972268-7f2b-4dcf-b48a-3234935cd661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96972268-7f2b-4dcf-b48a-3234935cd661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945b8652-392f-41b2-8765-0a38018e3721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:56 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Volume 91aca460-282f-4650-b1f4-701576fb8fb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91aca460-282f-4650-b1f4-701576fb8fb1', 'volume_size': 1} Sep 28 17:10:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:56 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1097640656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91aca460-282f-4650-b1f4-701576fb8fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24fc1a7d580a4aa78de3a2202654ff51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:56Z,use_quota=True,user_id='2aa4425bc03148ffa84b0aed803452ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:56 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Creating volume 91aca460-282f-4650-b1f4-701576fb8fb1 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:56 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:56 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:56 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:56 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:10:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:56 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1 1073741824 Sep 28 17:10:56 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:56 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1 1073741824" returned: 0 in 0.823s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:56 devstack sudo[94483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1 Sep 28 17:10:56 devstack sudo[94483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:57 devstack sudo[94483]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1" returned: 0 in 0.436s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945b8652-392f-41b2-8765-0a38018e3721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91aca460-282f-4650-b1f4-701576fb8fb1', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f5bb52-b1f3-4c0a-af41-6a93bbfa5ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:57 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Volume volume-91aca460-282f-4650-b1f4-701576fb8fb1 (91aca460-282f-4650-b1f4-701576fb8fb1): created successfully Sep 28 17:10:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f5bb52-b1f3-4c0a-af41-6a93bbfa5ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Flow 'volume_create_manager' (dff86ab7-708b-4487-b82a-2baeab016255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:57 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-3b3f303b-09c7-4913-a161-e72ae741210f tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Created volume successfully. Sep 28 17:10:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b6d2f28b-25bd-47a3-9fec-cbb33c987b41 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b6d2f28b-25bd-47a3-9fec-cbb33c987b41 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-b6d2f28b-25bd-47a3-9fec-cbb33c987b41 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Creating offline snapshot c5507a2b-5754-4ebc-b235-d77d587eb411 of volume 91aca460-282f-4650-b1f4-701576fb8fb1 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:10:58 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9b0af7-5da9-4216-a434-c44bb2fdccb3]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b6d2f28b-25bd-47a3-9fec-cbb33c987b41 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:58 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1 Sep 28 17:10:58 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:59 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b6d2f28b-25bd-47a3-9fec-cbb33c987b41 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1" returned: 0 in 0.766s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b6d2f28b-25bd-47a3-9fec-cbb33c987b41 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.c5507a2b-5754-4ebc-b235-d77d587eb411 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:59 devstack sudo[94496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.c5507a2b-5754-4ebc-b235-d77d587eb411 1G Sep 28 17:10:59 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:00 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b6d2f28b-25bd-47a3-9fec-cbb33c987b41 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.c5507a2b-5754-4ebc-b235-d77d587eb411 1G" returned: 0 in 0.958s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b6d2f28b-25bd-47a3-9fec-cbb33c987b41 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91aca460-282f-4650-b1f4-701576fb8fb1 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.c5507a2b-5754-4ebc-b235-d77d587eb411 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:00 devstack sudo[94503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91aca460-282f-4650-b1f4-701576fb8fb1 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.c5507a2b-5754-4ebc-b235-d77d587eb411 Sep 28 17:11:00 devstack sudo[94503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:00 devstack sudo[94503]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b6d2f28b-25bd-47a3-9fec-cbb33c987b41 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91aca460-282f-4650-b1f4-701576fb8fb1 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.c5507a2b-5754-4ebc-b235-d77d587eb411" returned: 0 in 0.768s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:00 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-b6d2f28b-25bd-47a3-9fec-cbb33c987b41 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.c5507a2b-5754-4ebc-b235-d77d587eb411 is being set with open permissions: ugo+rw Sep 28 17:11:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b6d2f28b-25bd-47a3-9fec-cbb33c987b41 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.c5507a2b-5754-4ebc-b235-d77d587eb411 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:00 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.c5507a2b-5754-4ebc-b235-d77d587eb411 Sep 28 17:11:00 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:01 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b6d2f28b-25bd-47a3-9fec-cbb33c987b41 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.c5507a2b-5754-4ebc-b235-d77d587eb411" returned: 0 in 0.445s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b6d2f28b-25bd-47a3-9fec-cbb33c987b41 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:01 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.info Sep 28 17:11:01 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:01 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b6d2f28b-25bd-47a3-9fec-cbb33c987b41 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.info" returned: 0 in 0.411s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:01 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-b6d2f28b-25bd-47a3-9fec-cbb33c987b41 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.info is being set with open permissions: ugo+rw Sep 28 17:11:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b6d2f28b-25bd-47a3-9fec-cbb33c987b41 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:01 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.info Sep 28 17:11:01 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:02 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b6d2f28b-25bd-47a3-9fec-cbb33c987b41 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.info" returned: 0 in 0.494s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b6d2f28b-25bd-47a3-9fec-cbb33c987b41 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.067s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:02 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-b6d2f28b-25bd-47a3-9fec-cbb33c987b41 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Create snapshot completed successfully Sep 28 17:11:02 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Flow 'volume_create_manager' (fd1d6850-574f-4ede-848b-7158dc65a852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7172486-99d5-469e-83a2-428c5110dff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7172486-99d5-469e-83a2-428c5110dff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-479493380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805fe593-bf3d-4075-ba19-4e979feb732f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8691ee1d0f548a1adc95af35fa52d46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:02Z,use_quota=True,user_id='8f38b56ba0d148faa8e88335c05cc332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57f5b13-52ce-4b05-9781-39bfa7c54109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57f5b13-52ce-4b05-9781-39bfa7c54109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c6966f-3ad7-4220-95c9-ffe9d89d136d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:02 devstack cinder-volume[87061]: DEBUG cinder.image.glance [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Creating Keystone auth plugin from conf {{(pid=87061) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:11:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c6966f-3ad7-4220-95c9-ffe9d89d136d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '805fe593-bf3d-4075-ba19-4e979feb732f', 'volume_name': 'volume-805fe593-bf3d-4075-ba19-4e979feb732f', 'volume_size': 1, 'image_id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21d27c6a4ac749c0a5b3cbd558b3b102', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'created_at': datetime.datetime(2026, 9, 28, 14, 57, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3da6edc3-4055-4154-be43-a897ff97d7cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf33e78-09c2-4305-8f9d-6a087e52ae17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf33e78-09c2-4305-8f9d-6a087e52ae17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a896054a-85db-43c8-89b4-6c548423b483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:03 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Volume 805fe593-bf3d-4075-ba19-4e979feb732f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-805fe593-bf3d-4075-ba19-4e979feb732f', 'volume_size': 1, 'image_id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21d27c6a4ac749c0a5b3cbd558b3b102', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'created_at': datetime.datetime(2026, 9, 28, 14, 57, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3da6edc3-4055-4154-be43-a897ff97d7cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:11:03 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Trying to clone 805fe593-bf3d-4075-ba19-4e979feb732f from image 3da6edc3-4055-4154-be43-a897ff97d7cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}]). {{(pid=87061) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:11:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d0059ba8-2c3d-4213-8007-b952215485fc tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Acquiring lock "cinder-c5507a2b-5754-4ebc-b235-d77d587eb411-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d0059ba8-2c3d-4213-8007-b952215485fc tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Lock "cinder-c5507a2b-5754-4ebc-b235-d77d587eb411-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d0059ba8-2c3d-4213-8007-b952215485fc tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Acquiring lock "cinder-quobyte-91aca460-282f-4650-b1f4-701576fb8fb1" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d0059ba8-2c3d-4213-8007-b952215485fc tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Lock "cinder-quobyte-91aca460-282f-4650-b1f4-701576fb8fb1" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d0059ba8-2c3d-4213-8007-b952215485fc tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Acquiring lock "cinder-quobyte-c5507a2b-5754-4ebc-b235-d77d587eb411" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d0059ba8-2c3d-4213-8007-b952215485fc tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Lock "cinder-quobyte-c5507a2b-5754-4ebc-b235-d77d587eb411" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-d0059ba8-2c3d-4213-8007-b952215485fc tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Deleting offline snapshot c5507a2b-5754-4ebc-b235-d77d587eb411 of volume 91aca460-282f-4650-b1f4-701576fb8fb1 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:11:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-d0059ba8-2c3d-4213-8007-b952215485fc tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] snapshot_file for this snap is: volume-91aca460-282f-4650-b1f4-701576fb8fb1.c5507a2b-5754-4ebc-b235-d77d587eb411 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:11:03 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_oqqjow99devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:11:03 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:11:03 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[964c2eff-4779-4139-957d-97bb6b058b05]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0059ba8-2c3d-4213-8007-b952215485fc tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.c5507a2b-5754-4ebc-b235-d77d587eb411 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:03 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[93761541-8171-46fa-803c-9d95fe9a3f12]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_oqqjow99devstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:03 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.c5507a2b-5754-4ebc-b235-d77d587eb411 Sep 28 17:11:03 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:03 devstack sudo[94571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_oqqjow99devstack@QuobyteHD Sep 28 17:11:03 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:04 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_oqqjow99devstack@QuobyteHD" returned: 0 in 0.495s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:04 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Temporary image 3da6edc3-4055-4154-be43-a897ff97d7cf is fetched for user 8f38b56ba0d148faa8e88335c05cc332. {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:11:04 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0059ba8-2c3d-4213-8007-b952215485fc tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.c5507a2b-5754-4ebc-b235-d77d587eb411" returned: 0 in 0.651s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-d0059ba8-2c3d-4213-8007-b952215485fc tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91aca460-282f-4650-b1f4-701576fb8fb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:11:04 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[341025b1-0559-45b7-b546-9861207771e5]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0059ba8-2c3d-4213-8007-b952215485fc tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:04 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9f8184-1aa7-43e9-8a49-d6072e9744a6]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_oqqjow99devstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:04 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_oqqjow99devstack@QuobyteHD Sep 28 17:11:04 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:04 devstack sudo[94580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1 Sep 28 17:11:04 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:05 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_oqqjow99devstack@QuobyteHD" returned: 0 in 0.598s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-479493380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805fe593-bf3d-4075-ba19-4e979feb732f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8691ee1d0f548a1adc95af35fa52d46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:02Z,use_quota=True,user_id='8f38b56ba0d148faa8e88335c05cc332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Creating volume 805fe593-bf3d-4075-ba19-4e979feb732f {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:05 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:11:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-805fe593-bf3d-4075-ba19-4e979feb732f 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:05 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-805fe593-bf3d-4075-ba19-4e979feb732f 1073741824 Sep 28 17:11:05 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:05 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0059ba8-2c3d-4213-8007-b952215485fc tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1" returned: 0 in 0.934s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0059ba8-2c3d-4213-8007-b952215485fc tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.c5507a2b-5754-4ebc-b235-d77d587eb411 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:05 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.c5507a2b-5754-4ebc-b235-d77d587eb411 Sep 28 17:11:05 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:06 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0059ba8-2c3d-4213-8007-b952215485fc tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.c5507a2b-5754-4ebc-b235-d77d587eb411" returned: 0 in 0.824s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0059ba8-2c3d-4213-8007-b952215485fc tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.c5507a2b-5754-4ebc-b235-d77d587eb411 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:06 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-805fe593-bf3d-4075-ba19-4e979feb732f 1073741824" returned: 0 in 1.106s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:06 devstack sudo[94660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.c5507a2b-5754-4ebc-b235-d77d587eb411 Sep 28 17:11:06 devstack sudo[94660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-805fe593-bf3d-4075-ba19-4e979feb732f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:06 devstack sudo[94664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-805fe593-bf3d-4075-ba19-4e979feb732f Sep 28 17:11:06 devstack sudo[94664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:06 devstack sudo[94660]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0059ba8-2c3d-4213-8007-b952215485fc tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1.c5507a2b-5754-4ebc-b235-d77d587eb411" returned: 0 in 0.453s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:06 devstack sudo[94664]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-805fe593-bf3d-4075-ba19-4e979feb732f" returned: 0 in 0.438s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d0059ba8-2c3d-4213-8007-b952215485fc tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Lock "cinder-quobyte-c5507a2b-5754-4ebc-b235-d77d587eb411" released by "_delete_snapshot" :: held 3.122s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d0059ba8-2c3d-4213-8007-b952215485fc tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Lock "cinder-quobyte-91aca460-282f-4650-b1f4-701576fb8fb1" released by "delete_snapshot" :: held 3.172s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:06 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Attempting download of 3da6edc3-4055-4154-be43-a897ff97d7cf ((None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}])) to volume 805fe593-bf3d-4075-ba19-4e979feb732f. {{(pid=87061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:11:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:11:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:06 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:11:06 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:06 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77cdf07-ec29-4883-9446-2599ab48de24]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_hy8_fwsy {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:06 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-d0059ba8-2c3d-4213-8007-b952215485fc tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Created reservations ['65a10c6f-eaac-4a64-aab3-d1cb313ed1c8', 'c150b6ad-d6ff-4cb3-ad23-6603b03a8e6c', '585ab37d-8be7-42ba-9f25-0f39b5007c70', '39c96b53-a4c2-451e-90f3-da9f18f9cd6e'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:07 devstack sudo[94691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_hy8_fwsy Sep 28 17:11:07 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:07 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d0059ba8-2c3d-4213-8007-b952215485fc tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Delete snapshot completed successfully. Sep 28 17:11:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d0059ba8-2c3d-4213-8007-b952215485fc tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Lock "cinder-c5507a2b-5754-4ebc-b235-d77d587eb411-delete_snapshot" released by "delete_snapshot" :: held 3.637s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:07 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.501s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:11:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:11:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:11:07 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_hy8_fwsy" returned: 0 in 0.639s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_hy8_fwsy {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:07 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_hy8_fwsy Sep 28 17:11:07 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2ec2ce45-f905-4ad1-92e2-2d76467d2c93 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Acquiring lock "cinder-91aca460-282f-4650-b1f4-701576fb8fb1-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2ec2ce45-f905-4ad1-92e2-2d76467d2c93 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Lock "cinder-91aca460-282f-4650-b1f4-701576fb8fb1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:08 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2ec2ce45-f905-4ad1-92e2-2d76467d2c93 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Acquiring lock "cinder-quobyte-91aca460-282f-4650-b1f4-701576fb8fb1" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:08 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:08 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2ec2ce45-f905-4ad1-92e2-2d76467d2c93 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Lock "cinder-quobyte-91aca460-282f-4650-b1f4-701576fb8fb1" acquired by "delete_volume" :: waited 0.028s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_hy8_fwsy" returned: 1 in 0.629s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_hy8_fwsy' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:11:08 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[28415b08-92af-4bfc-aacd-048ca97f8f3f]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_oqqjow99devstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:08 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[36150b63-23c1-46b4-a1dc-9fc424dc9c0a]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2ec2ce45-f905-4ad1-92e2-2d76467d2c93 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:08 devstack sudo[94701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_oqqjow99devstack@QuobyteHD Sep 28 17:11:08 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:08 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1 Sep 28 17:11:08 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:08 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_oqqjow99devstack@QuobyteHD" returned: 0 in 0.830s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:08 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] 3da6edc3-4055-4154-be43-a897ff97d7cf was qcow2, converting to qcow2 {{(pid=87061) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:11:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_oqqjow99devstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-805fe593-bf3d-4075-ba19-4e979feb732f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:08 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2ec2ce45-f905-4ad1-92e2-2d76467d2c93 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1" returned: 0 in 0.863s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2ec2ce45-f905-4ad1-92e2-2d76467d2c93 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:09 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_oqqjow99devstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-805fe593-bf3d-4075-ba19-4e979feb732f Sep 28 17:11:09 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:09 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1 Sep 28 17:11:09 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:09 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2ec2ce45-f905-4ad1-92e2-2d76467d2c93 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-91aca460-282f-4650-b1f4-701576fb8fb1" returned: 0 in 0.505s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2ec2ce45-f905-4ad1-92e2-2d76467d2c93 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Lock "cinder-quobyte-91aca460-282f-4650-b1f4-701576fb8fb1" released by "delete_volume" :: held 1.494s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:09 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-2ec2ce45-f905-4ad1-92e2-2d76467d2c93 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Created reservations ['f7d411ce-d1fd-4a87-bea6-fe5193e2b2d1', 'e4bb700a-7ef2-454f-aa05-4e69b6afb0cc', 'e78f6513-4323-4fc9-93d1-4a316b7bfce1', 'cf00153d-2d9e-4dde-b648-3916594f4831'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2ec2ce45-f905-4ad1-92e2-2d76467d2c93 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2ec2ce45-f905-4ad1-92e2-2d76467d2c93 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2ec2ce45-f905-4ad1-92e2-2d76467d2c93 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2ec2ce45-f905-4ad1-92e2-2d76467d2c93 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2ec2ce45-f905-4ad1-92e2-2d76467d2c93 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2ec2ce45-f905-4ad1-92e2-2d76467d2c93 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:09 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:11:09 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:10 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2ec2ce45-f905-4ad1-92e2-2d76467d2c93 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.474s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:10 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-2ec2ce45-f905-4ad1-92e2-2d76467d2c93 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:10 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-2ec2ce45-f905-4ad1-92e2-2d76467d2c93 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Deleted volume successfully. Sep 28 17:11:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2ec2ce45-f905-4ad1-92e2-2d76467d2c93 tempest-VolumeSnapshotQuotasNegativeTestJSON-843800562 None] Lock "cinder-91aca460-282f-4650-b1f4-701576fb8fb1-delete_volume" released by "delete_volume" :: held 2.318s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:12 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_oqqjow99devstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-805fe593-bf3d-4075-ba19-4e979feb732f" returned: 0 in 3.734s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:12 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_oqqjow99devstack@QuobyteHD, size 112.00 MB, duration 3.73 sec, destination /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-805fe593-bf3d-4075-ba19-4e979feb732f {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:11:12 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Converted 112.00 MB image at 29.99 MB/s Sep 28 17:11:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-805fe593-bf3d-4075-ba19-4e979feb732f 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:12 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-805fe593-bf3d-4075-ba19-4e979feb732f 1G Sep 28 17:11:12 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:13 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-805fe593-bf3d-4075-ba19-4e979feb732f 1G" returned: 0 in 0.659s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:13 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Downloaded image 3da6edc3-4055-4154-be43-a897ff97d7cf ((None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}])) to volume 805fe593-bf3d-4075-ba19-4e979feb732f successfully. {{(pid=87061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:11:13 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Temporary image 3da6edc3-4055-4154-be43-a897ff97d7cf for user 8f38b56ba0d148faa8e88335c05cc332 is deleted. {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:11:13 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Marking volume 805fe593-bf3d-4075-ba19-4e979feb732f as bootable. {{(pid=87061) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:11:13 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Copying metadata from image 3da6edc3-4055-4154-be43-a897ff97d7cf to 805fe593-bf3d-4075-ba19-4e979feb732f. {{(pid=87061) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:11:13 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Creating volume glance metadata for volume 805fe593-bf3d-4075-ba19-4e979feb732f backed by image 3da6edc3-4055-4154-be43-a897ff97d7cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87061) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:11:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a896054a-85db-43c8-89b4-6c548423b483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-805fe593-bf3d-4075-ba19-4e979feb732f', 'volume_size': 1, 'image_id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21d27c6a4ac749c0a5b3cbd558b3b102', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'created_at': datetime.datetime(2026, 9, 28, 14, 57, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3da6edc3-4055-4154-be43-a897ff97d7cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c32e76-fb06-4447-bfd6-1e92e8bef4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:13 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Volume volume-805fe593-bf3d-4075-ba19-4e979feb732f (805fe593-bf3d-4075-ba19-4e979feb732f): created successfully Sep 28 17:11:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c32e76-fb06-4447-bfd6-1e92e8bef4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Flow 'volume_create_manager' (fd1d6850-574f-4ede-848b-7158dc65a852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:13 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-621a1164-0cfb-436a-961d-486ed3d85916 tempest-VolumesImageMetadata-1364682040 None] Created volume successfully. Sep 28 17:11:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-19ffeb50-b2d1-4877-8467-96723b0a1a57 tempest-VolumesImageMetadata-1364682040 None] Acquiring lock "cinder-805fe593-bf3d-4075-ba19-4e979feb732f-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-19ffeb50-b2d1-4877-8467-96723b0a1a57 tempest-VolumesImageMetadata-1364682040 None] Lock "cinder-805fe593-bf3d-4075-ba19-4e979feb732f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-19ffeb50-b2d1-4877-8467-96723b0a1a57 tempest-VolumesImageMetadata-1364682040 None] Acquiring lock "cinder-quobyte-805fe593-bf3d-4075-ba19-4e979feb732f" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-19ffeb50-b2d1-4877-8467-96723b0a1a57 tempest-VolumesImageMetadata-1364682040 None] Lock "cinder-quobyte-805fe593-bf3d-4075-ba19-4e979feb732f" acquired by "delete_volume" :: waited 0.031s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:16 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[254e4d4d-7430-4570-8b5d-43bdc5707859]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19ffeb50-b2d1-4877-8467-96723b0a1a57 tempest-VolumesImageMetadata-1364682040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-805fe593-bf3d-4075-ba19-4e979feb732f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:16 devstack sudo[94748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-805fe593-bf3d-4075-ba19-4e979feb732f Sep 28 17:11:16 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:17 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19ffeb50-b2d1-4877-8467-96723b0a1a57 tempest-VolumesImageMetadata-1364682040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-805fe593-bf3d-4075-ba19-4e979feb732f" returned: 0 in 0.555s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19ffeb50-b2d1-4877-8467-96723b0a1a57 tempest-VolumesImageMetadata-1364682040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-805fe593-bf3d-4075-ba19-4e979feb732f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:17 devstack sudo[94753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-805fe593-bf3d-4075-ba19-4e979feb732f Sep 28 17:11:17 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:17 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19ffeb50-b2d1-4877-8467-96723b0a1a57 tempest-VolumesImageMetadata-1364682040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-805fe593-bf3d-4075-ba19-4e979feb732f" returned: 0 in 0.440s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-19ffeb50-b2d1-4877-8467-96723b0a1a57 tempest-VolumesImageMetadata-1364682040 None] Lock "cinder-quobyte-805fe593-bf3d-4075-ba19-4e979feb732f" released by "delete_volume" :: held 1.096s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:17 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-19ffeb50-b2d1-4877-8467-96723b0a1a57 tempest-VolumesImageMetadata-1364682040 None] Created reservations ['cf9a6fc9-10e9-4d0a-838c-30f5326bb0c2', '2d8fe7cd-383f-43a6-b58a-7530700c8411', '55ec9e96-989e-4105-bc27-49e02b4e6717', '30dd0ce5-e3d9-4906-be45-da7f77b2aefd'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-19ffeb50-b2d1-4877-8467-96723b0a1a57 tempest-VolumesImageMetadata-1364682040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-19ffeb50-b2d1-4877-8467-96723b0a1a57 tempest-VolumesImageMetadata-1364682040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-19ffeb50-b2d1-4877-8467-96723b0a1a57 tempest-VolumesImageMetadata-1364682040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-19ffeb50-b2d1-4877-8467-96723b0a1a57 tempest-VolumesImageMetadata-1364682040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-19ffeb50-b2d1-4877-8467-96723b0a1a57 tempest-VolumesImageMetadata-1364682040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19ffeb50-b2d1-4877-8467-96723b0a1a57 tempest-VolumesImageMetadata-1364682040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:17 devstack sudo[94756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:11:17 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:18 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19ffeb50-b2d1-4877-8467-96723b0a1a57 tempest-VolumesImageMetadata-1364682040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.411s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:18 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-19ffeb50-b2d1-4877-8467-96723b0a1a57 tempest-VolumesImageMetadata-1364682040 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:18 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-19ffeb50-b2d1-4877-8467-96723b0a1a57 tempest-VolumesImageMetadata-1364682040 None] Deleted volume successfully. Sep 28 17:11:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-19ffeb50-b2d1-4877-8467-96723b0a1a57 tempest-VolumesImageMetadata-1364682040 None] Lock "cinder-805fe593-bf3d-4075-ba19-4e979feb732f-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:27 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=31,cinder:UPDATE=27,cinder:INSERT=13,cinder:DELETE=1 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:11:28 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:UPDATE=71,cinder:SELECT=54,cinder:INSERT=22,cinder:DELETE=8 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:11:31 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:31 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Flow 'volume_create_manager' (42e80069-2027-49ff-a0c4-9756e7aa50e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:31 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1cc34c4-40e2-4d27-a780-9c081b38c0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:31 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1cc34c4-40e2-4d27-a780-9c081b38c0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-118314189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f4a8d9-64e9-4821-86b9-e430408a6bd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2996b0bbefc84cda990a7302f0bc70cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:31Z,use_quota=True,user_id='4906984113dd4a7f903e9202e29d6a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:31 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1a7261-50da-4dae-887b-5489c4a32490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:31 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1a7261-50da-4dae-887b-5489c4a32490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:31 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aee9cf5-9a72-4447-b1d1-398a608196ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:31 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aee9cf5-9a72-4447-b1d1-398a608196ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f4a8d9-64e9-4821-86b9-e430408a6bd4', 'volume_name': 'volume-61f4a8d9-64e9-4821-86b9-e430408a6bd4', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:31 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c15d64-dbcd-41d0-9013-feabe3afd3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:31 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c15d64-dbcd-41d0-9013-feabe3afd3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:31 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5ca6b7-b7d6-4715-beb0-c22fa3d61cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:31 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Volume 61f4a8d9-64e9-4821-86b9-e430408a6bd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f4a8d9-64e9-4821-86b9-e430408a6bd4', 'volume_size': 1} Sep 28 17:11:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:31 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-118314189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f4a8d9-64e9-4821-86b9-e430408a6bd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2996b0bbefc84cda990a7302f0bc70cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:31Z,use_quota=True,user_id='4906984113dd4a7f903e9202e29d6a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:31 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Creating volume 61f4a8d9-64e9-4821-86b9-e430408a6bd4 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:31 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:31 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:31 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:31 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:11:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-61f4a8d9-64e9-4821-86b9-e430408a6bd4 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:31 devstack sudo[94896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-61f4a8d9-64e9-4821-86b9-e430408a6bd4 1073741824 Sep 28 17:11:31 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:32 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-61f4a8d9-64e9-4821-86b9-e430408a6bd4 1073741824" returned: 0 in 0.666s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-61f4a8d9-64e9-4821-86b9-e430408a6bd4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:32 devstack sudo[94902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-61f4a8d9-64e9-4821-86b9-e430408a6bd4 Sep 28 17:11:32 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:32 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-61f4a8d9-64e9-4821-86b9-e430408a6bd4" returned: 0 in 0.474s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5ca6b7-b7d6-4715-beb0-c22fa3d61cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f4a8d9-64e9-4821-86b9-e430408a6bd4', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c204ad-cd94-432a-b8c6-52f864d65bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:33 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Volume volume-61f4a8d9-64e9-4821-86b9-e430408a6bd4 (61f4a8d9-64e9-4821-86b9-e430408a6bd4): created successfully Sep 28 17:11:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c204ad-cd94-432a-b8c6-52f864d65bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Flow 'volume_create_manager' (42e80069-2027-49ff-a0c4-9756e7aa50e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:33 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-91b71348-f3ce-4744-b4fd-5ab21d3b1de4 tempest-VolumesActionsTest-246690682 None] Created volume successfully. Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eaba5880-47e9-4f9d-abdf-dafb588053af tempest-VolumesActionsTest-246690682 None] Acquiring lock "cinder-61f4a8d9-64e9-4821-86b9-e430408a6bd4" by "attach_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eaba5880-47e9-4f9d-abdf-dafb588053af tempest-VolumesActionsTest-246690682 None] Lock "cinder-61f4a8d9-64e9-4821-86b9-e430408a6bd4" acquired by "attach_volume" :: waited 0.025s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:34 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-eaba5880-47e9-4f9d-abdf-dafb588053af tempest-VolumesActionsTest-246690682 None] Attaching volume 61f4a8d9-64e9-4821-86b9-e430408a6bd4 to instance 1bb14cff-86e3-4d9d-bc33-83d04892334c at mountpoint /dev/vdb on host None. Sep 28 17:11:34 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-eaba5880-47e9-4f9d-abdf-dafb588053af tempest-VolumesActionsTest-246690682 None] Attach volume completed successfully. Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eaba5880-47e9-4f9d-abdf-dafb588053af tempest-VolumesActionsTest-246690682 None] Lock "cinder-61f4a8d9-64e9-4821-86b9-e430408a6bd4" released by "attach_volume" :: held 0.168s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Flow 'volume_create_manager' (97c2d16d-da6e-4972-a35d-4d13ead1670a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da627af7-513f-481a-90ae-6b77bb57a4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da627af7-513f-481a-90ae-6b77bb57a4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-398369961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb52734-11dc-43ef-b773-45fe688b1e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='231130faf28c40e7bf079851c5b01fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:34Z,use_quota=True,user_id='26950c66128241f9ad7e87131160c4e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9008d15-73ac-4ced-9e41-c6871e0f27a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9008d15-73ac-4ced-9e41-c6871e0f27a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1892b1e6-2503-4c20-b65b-663aa4670d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1892b1e6-2503-4c20-b65b-663aa4670d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fb52734-11dc-43ef-b773-45fe688b1e7d', 'volume_name': 'volume-1fb52734-11dc-43ef-b773-45fe688b1e7d', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39c5a46-89da-49fa-89e3-f8adbec7bd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39c5a46-89da-49fa-89e3-f8adbec7bd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11f2fdd-242a-4a7b-9f44-d55b660843ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:34 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Volume 1fb52734-11dc-43ef-b773-45fe688b1e7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fb52734-11dc-43ef-b773-45fe688b1e7d', 'volume_size': 1} Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-398369961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb52734-11dc-43ef-b773-45fe688b1e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='231130faf28c40e7bf079851c5b01fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:34Z,use_quota=True,user_id='26950c66128241f9ad7e87131160c4e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Creating volume 1fb52734-11dc-43ef-b773-45fe688b1e7d {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:34 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:11:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1fb52734-11dc-43ef-b773-45fe688b1e7d 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:34 devstack sudo[94912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1fb52734-11dc-43ef-b773-45fe688b1e7d 1073741824 Sep 28 17:11:34 devstack sudo[94912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:35 devstack sudo[94912]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1fb52734-11dc-43ef-b773-45fe688b1e7d 1073741824" returned: 0 in 0.792s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Flow 'volume_create_manager' (9be8099f-4b71-466d-bd60-de9eef783437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e003aba8-5a38-47bc-a648-3eaa1a7cc6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e003aba8-5a38-47bc-a648-3eaa1a7cc6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1657324081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760f1c9e-6ee9-471c-84ef-23d0743b3046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2fee435fc7142c0ad220094494a6dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:35Z,use_quota=True,user_id='9d5550f4f5654c76aa65029f9ba77a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a1f4c2-f390-4b5b-afad-8544755d24ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a1f4c2-f390-4b5b-afad-8544755d24ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a6a4cf-6cdb-4ce1-ba3e-7cdf55f35572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a6a4cf-6cdb-4ce1-ba3e-7cdf55f35572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '760f1c9e-6ee9-471c-84ef-23d0743b3046', 'volume_name': 'volume-760f1c9e-6ee9-471c-84ef-23d0743b3046', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb4ab7d-5399-42ca-9367-5d9b420209d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb4ab7d-5399-42ca-9367-5d9b420209d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de63328f-caed-4a90-8c43-a3daf8e38993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:35 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Volume 760f1c9e-6ee9-471c-84ef-23d0743b3046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-760f1c9e-6ee9-471c-84ef-23d0743b3046', 'volume_size': 1} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1fb52734-11dc-43ef-b773-45fe688b1e7d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:35 devstack sudo[94918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1fb52734-11dc-43ef-b773-45fe688b1e7d Sep 28 17:11:35 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:35 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-86eebe7f-52b2-4187-b2d5-b74c665248ab tempest-VolumesActionsTest-1666652462 None] Terminate volume connection completed successfully. Sep 28 17:11:35 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-86eebe7f-52b2-4187-b2d5-b74c665248ab tempest-VolumesActionsTest-1666652462 None] Acquiring lock "cinder-61f4a8d9-64e9-4821-86b9-e430408a6bd4-detach_volume" by "detach_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1fb52734-11dc-43ef-b773-45fe688b1e7d" returned: 0 in 0.430s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.466s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1657324081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760f1c9e-6ee9-471c-84ef-23d0743b3046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2fee435fc7142c0ad220094494a6dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:35Z,use_quota=True,user_id='9d5550f4f5654c76aa65029f9ba77a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Creating volume 760f1c9e-6ee9-471c-84ef-23d0743b3046 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:35 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-760f1c9e-6ee9-471c-84ef-23d0743b3046 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-86eebe7f-52b2-4187-b2d5-b74c665248ab tempest-VolumesActionsTest-1666652462 None] Lock "cinder-61f4a8d9-64e9-4821-86b9-e430408a6bd4-detach_volume" acquired by "detach_volume" :: waited 0.063s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:35 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-760f1c9e-6ee9-471c-84ef-23d0743b3046 1073741824 Sep 28 17:11:35 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-86eebe7f-52b2-4187-b2d5-b74c665248ab tempest-VolumesActionsTest-1666652462 None] Detaching volume 61f4a8d9-64e9-4821-86b9-e430408a6bd4 from instance 1bb14cff-86e3-4d9d-bc33-83d04892334c. Sep 28 17:11:35 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11f2fdd-242a-4a7b-9f44-d55b660843ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fb52734-11dc-43ef-b773-45fe688b1e7d', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5174b6-06d1-4a35-b495-b2d5f15da5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:35 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Volume volume-1fb52734-11dc-43ef-b773-45fe688b1e7d (1fb52734-11dc-43ef-b773-45fe688b1e7d): created successfully Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5174b6-06d1-4a35-b495-b2d5f15da5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Flow 'volume_create_manager' (97c2d16d-da6e-4972-a35d-4d13ead1670a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:36 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d6237c04-c9fd-4bc7-8f0e-003a008be27c tempest-AttachVolumeTestJSON-1078994482 None] Created volume successfully. Sep 28 17:11:36 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-86eebe7f-52b2-4187-b2d5-b74c665248ab tempest-VolumesActionsTest-1666652462 None] Detach volume completed successfully. Sep 28 17:11:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-86eebe7f-52b2-4187-b2d5-b74c665248ab tempest-VolumesActionsTest-1666652462 None] Lock "cinder-61f4a8d9-64e9-4821-86b9-e430408a6bd4-detach_volume" released by "detach_volume" :: held 0.159s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-212e744b-517e-4823-8472-104be82e8b10 tempest-VolumesActionsTest-246690682 None] Acquiring lock "cinder-61f4a8d9-64e9-4821-86b9-e430408a6bd4-detach_volume" by "detach_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-212e744b-517e-4823-8472-104be82e8b10 tempest-VolumesActionsTest-246690682 None] Lock "cinder-61f4a8d9-64e9-4821-86b9-e430408a6bd4-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:36 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-212e744b-517e-4823-8472-104be82e8b10 tempest-VolumesActionsTest-246690682 None] Volume detach called, but volume not attached. Sep 28 17:11:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-212e744b-517e-4823-8472-104be82e8b10 tempest-VolumesActionsTest-246690682 None] Lock "cinder-61f4a8d9-64e9-4821-86b9-e430408a6bd4-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:36 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-760f1c9e-6ee9-471c-84ef-23d0743b3046 1073741824" returned: 0 in 0.718s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-760f1c9e-6ee9-471c-84ef-23d0743b3046 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:36 devstack sudo[94926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-760f1c9e-6ee9-471c-84ef-23d0743b3046 Sep 28 17:11:36 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9ff03aae-9c87-4bce-8fbd-6abaaf22fd3b tempest-VolumesActionsTest-246690682 None] Acquiring lock "cinder-61f4a8d9-64e9-4821-86b9-e430408a6bd4-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9ff03aae-9c87-4bce-8fbd-6abaaf22fd3b tempest-VolumesActionsTest-246690682 None] Lock "cinder-61f4a8d9-64e9-4821-86b9-e430408a6bd4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9ff03aae-9c87-4bce-8fbd-6abaaf22fd3b tempest-VolumesActionsTest-246690682 None] Acquiring lock "cinder-quobyte-61f4a8d9-64e9-4821-86b9-e430408a6bd4" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9ff03aae-9c87-4bce-8fbd-6abaaf22fd3b tempest-VolumesActionsTest-246690682 None] Lock "cinder-quobyte-61f4a8d9-64e9-4821-86b9-e430408a6bd4" acquired by "delete_volume" :: waited 0.026s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:36 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c473bbd-ba47-4f0c-9a4a-24b284ab8af7]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ff03aae-9c87-4bce-8fbd-6abaaf22fd3b tempest-VolumesActionsTest-246690682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-61f4a8d9-64e9-4821-86b9-e430408a6bd4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:37 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-61f4a8d9-64e9-4821-86b9-e430408a6bd4 Sep 28 17:11:37 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:37 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-760f1c9e-6ee9-471c-84ef-23d0743b3046" returned: 0 in 0.658s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de63328f-caed-4a90-8c43-a3daf8e38993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-760f1c9e-6ee9-471c-84ef-23d0743b3046', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f916d029-9136-4ead-8109-b0be60324050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:37 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Volume volume-760f1c9e-6ee9-471c-84ef-23d0743b3046 (760f1c9e-6ee9-471c-84ef-23d0743b3046): created successfully Sep 28 17:11:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f916d029-9136-4ead-8109-b0be60324050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Flow 'volume_create_manager' (9be8099f-4b71-466d-bd60-de9eef783437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:37 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a8c86d0e-c062-4769-bf02-76cd0856fc91 tempest-AbsoluteLimitsTests-130805750 None] Created volume successfully. Sep 28 17:11:37 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ff03aae-9c87-4bce-8fbd-6abaaf22fd3b tempest-VolumesActionsTest-246690682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-61f4a8d9-64e9-4821-86b9-e430408a6bd4" returned: 0 in 0.767s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ff03aae-9c87-4bce-8fbd-6abaaf22fd3b tempest-VolumesActionsTest-246690682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-61f4a8d9-64e9-4821-86b9-e430408a6bd4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:37 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-61f4a8d9-64e9-4821-86b9-e430408a6bd4 Sep 28 17:11:37 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:38 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ff03aae-9c87-4bce-8fbd-6abaaf22fd3b tempest-VolumesActionsTest-246690682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-61f4a8d9-64e9-4821-86b9-e430408a6bd4" returned: 0 in 0.445s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9ff03aae-9c87-4bce-8fbd-6abaaf22fd3b tempest-VolumesActionsTest-246690682 None] Lock "cinder-quobyte-61f4a8d9-64e9-4821-86b9-e430408a6bd4" released by "delete_volume" :: held 1.309s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:38 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-9ff03aae-9c87-4bce-8fbd-6abaaf22fd3b tempest-VolumesActionsTest-246690682 None] Created reservations ['13773ee3-9586-4e66-a12d-dd74f718c991', 'e129781e-a275-479b-86e4-970c9128dc3a', '076eaf53-f45a-4681-8aec-983f2d7197e5', 'd74b4c82-747a-4f14-a4a6-3f6af628326a'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9ff03aae-9c87-4bce-8fbd-6abaaf22fd3b tempest-VolumesActionsTest-246690682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9ff03aae-9c87-4bce-8fbd-6abaaf22fd3b tempest-VolumesActionsTest-246690682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9ff03aae-9c87-4bce-8fbd-6abaaf22fd3b tempest-VolumesActionsTest-246690682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9ff03aae-9c87-4bce-8fbd-6abaaf22fd3b tempest-VolumesActionsTest-246690682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9ff03aae-9c87-4bce-8fbd-6abaaf22fd3b tempest-VolumesActionsTest-246690682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ff03aae-9c87-4bce-8fbd-6abaaf22fd3b tempest-VolumesActionsTest-246690682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:38 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:11:38 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-b1a58c55-4d9d-49ad-a43e-e1adf6c4ac51 req-09dd1080-49f1-4df0-b520-c83137e1e207 tempest-AttachVolumeTestJSON-1078994482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-b1a58c55-4d9d-49ad-a43e-e1adf6c4ac51 req-09dd1080-49f1-4df0-b520-c83137e1e207 tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-b1a58c55-4d9d-49ad-a43e-e1adf6c4ac51 req-09dd1080-49f1-4df0-b520-c83137e1e207 tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-b1a58c55-4d9d-49ad-a43e-e1adf6c4ac51 req-09dd1080-49f1-4df0-b520-c83137e1e207 tempest-AttachVolumeTestJSON-1078994482 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-1fb52734-11dc-43ef-b773-45fe688b1e7d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2ee56a5-df11-4112-9b8f-c188bf6e2b07', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:11:38 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ff03aae-9c87-4bce-8fbd-6abaaf22fd3b tempest-VolumesActionsTest-246690682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.405s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:38 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-9ff03aae-9c87-4bce-8fbd-6abaaf22fd3b tempest-VolumesActionsTest-246690682 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:38 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-9ff03aae-9c87-4bce-8fbd-6abaaf22fd3b tempest-VolumesActionsTest-246690682 None] Deleted volume successfully. Sep 28 17:11:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9ff03aae-9c87-4bce-8fbd-6abaaf22fd3b tempest-VolumesActionsTest-246690682 None] Lock "cinder-61f4a8d9-64e9-4821-86b9-e430408a6bd4-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:38 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-b1a58c55-4d9d-49ad-a43e-e1adf6c4ac51 req-09dd1080-49f1-4df0-b520-c83137e1e207 tempest-AttachVolumeTestJSON-1078994482 None] attachment_update completed successfully. Sep 28 17:11:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8efaed95-3eec-4881-bc8e-25aed1359915 tempest-AbsoluteLimitsTests-130805750 None] Acquiring lock "cinder-760f1c9e-6ee9-471c-84ef-23d0743b3046-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8efaed95-3eec-4881-bc8e-25aed1359915 tempest-AbsoluteLimitsTests-130805750 None] Lock "cinder-760f1c9e-6ee9-471c-84ef-23d0743b3046-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8efaed95-3eec-4881-bc8e-25aed1359915 tempest-AbsoluteLimitsTests-130805750 None] Acquiring lock "cinder-quobyte-760f1c9e-6ee9-471c-84ef-23d0743b3046" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8efaed95-3eec-4881-bc8e-25aed1359915 tempest-AbsoluteLimitsTests-130805750 None] Lock "cinder-quobyte-760f1c9e-6ee9-471c-84ef-23d0743b3046" acquired by "delete_volume" :: waited 0.033s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:39 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[75257d2a-fd30-4e5b-8dc4-ab4fd5dfd185]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8efaed95-3eec-4881-bc8e-25aed1359915 tempest-AbsoluteLimitsTests-130805750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-760f1c9e-6ee9-471c-84ef-23d0743b3046 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:39 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-760f1c9e-6ee9-471c-84ef-23d0743b3046 Sep 28 17:11:39 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:40 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8efaed95-3eec-4881-bc8e-25aed1359915 tempest-AbsoluteLimitsTests-130805750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-760f1c9e-6ee9-471c-84ef-23d0743b3046" returned: 0 in 0.515s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8efaed95-3eec-4881-bc8e-25aed1359915 tempest-AbsoluteLimitsTests-130805750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-760f1c9e-6ee9-471c-84ef-23d0743b3046 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:40 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-760f1c9e-6ee9-471c-84ef-23d0743b3046 Sep 28 17:11:40 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:40 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8efaed95-3eec-4881-bc8e-25aed1359915 tempest-AbsoluteLimitsTests-130805750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-760f1c9e-6ee9-471c-84ef-23d0743b3046" returned: 0 in 0.577s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8efaed95-3eec-4881-bc8e-25aed1359915 tempest-AbsoluteLimitsTests-130805750 None] Lock "cinder-quobyte-760f1c9e-6ee9-471c-84ef-23d0743b3046" released by "delete_volume" :: held 1.220s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:41 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-8efaed95-3eec-4881-bc8e-25aed1359915 tempest-AbsoluteLimitsTests-130805750 None] Created reservations ['e007c7ea-13cd-4115-be9b-eb353eaeb25b', '1e417d86-2c1d-420b-8dae-cc18f362b4b6', 'ae0cb953-dadb-44c8-9215-e2699a49c453', '2c87393a-788b-42c2-bb3c-0e0170fb2697'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8efaed95-3eec-4881-bc8e-25aed1359915 tempest-AbsoluteLimitsTests-130805750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8efaed95-3eec-4881-bc8e-25aed1359915 tempest-AbsoluteLimitsTests-130805750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8efaed95-3eec-4881-bc8e-25aed1359915 tempest-AbsoluteLimitsTests-130805750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8efaed95-3eec-4881-bc8e-25aed1359915 tempest-AbsoluteLimitsTests-130805750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8efaed95-3eec-4881-bc8e-25aed1359915 tempest-AbsoluteLimitsTests-130805750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8efaed95-3eec-4881-bc8e-25aed1359915 tempest-AbsoluteLimitsTests-130805750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:41 devstack sudo[95404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:11:41 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:41 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8efaed95-3eec-4881-bc8e-25aed1359915 tempest-AbsoluteLimitsTests-130805750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.451s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:41 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-8efaed95-3eec-4881-bc8e-25aed1359915 tempest-AbsoluteLimitsTests-130805750 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:41 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-8efaed95-3eec-4881-bc8e-25aed1359915 tempest-AbsoluteLimitsTests-130805750 None] Deleted volume successfully. Sep 28 17:11:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8efaed95-3eec-4881-bc8e-25aed1359915 tempest-AbsoluteLimitsTests-130805750 None] Lock "cinder-760f1c9e-6ee9-471c-84ef-23d0743b3046-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:45 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Flow 'volume_create_manager' (90b167bc-f076-40f8-84d6-1fb6af777b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69722efa-fe36-4a1f-b1ad-cab1179ae129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69722efa-fe36-4a1f-b1ad-cab1179ae129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-52016194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4076cff0-1e4a-49d6-88b0-794350955614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2996b0bbefc84cda990a7302f0bc70cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:45Z,use_quota=True,user_id='4906984113dd4a7f903e9202e29d6a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc4037e-9e88-4a51-ad20-2bdb54ecd3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc4037e-9e88-4a51-ad20-2bdb54ecd3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76796705-865c-4a09-9e5f-f6a60c7bd8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76796705-865c-4a09-9e5f-f6a60c7bd8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4076cff0-1e4a-49d6-88b0-794350955614', 'volume_name': 'volume-4076cff0-1e4a-49d6-88b0-794350955614', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2bff48b-bb41-4c81-84b1-ef9cebdaa01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2bff48b-bb41-4c81-84b1-ef9cebdaa01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e568701b-41f4-4a9a-9298-1e58c02857e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:45 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Volume 4076cff0-1e4a-49d6-88b0-794350955614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4076cff0-1e4a-49d6-88b0-794350955614', 'volume_size': 1} Sep 28 17:11:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-52016194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4076cff0-1e4a-49d6-88b0-794350955614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2996b0bbefc84cda990a7302f0bc70cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:45Z,use_quota=True,user_id='4906984113dd4a7f903e9202e29d6a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Creating volume 4076cff0-1e4a-49d6-88b0-794350955614 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:45 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:11:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4076cff0-1e4a-49d6-88b0-794350955614 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:45 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4076cff0-1e4a-49d6-88b0-794350955614 1073741824 Sep 28 17:11:45 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4076cff0-1e4a-49d6-88b0-794350955614 1073741824" returned: 0 in 0.789s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:46 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4076cff0-1e4a-49d6-88b0-794350955614 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:46 devstack sudo[95435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4076cff0-1e4a-49d6-88b0-794350955614 Sep 28 17:11:46 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4076cff0-1e4a-49d6-88b0-794350955614" returned: 0 in 0.527s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:46 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e568701b-41f4-4a9a-9298-1e58c02857e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4076cff0-1e4a-49d6-88b0-794350955614', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c6727a-188f-466b-91c9-710f9eb93a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:47 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Volume volume-4076cff0-1e4a-49d6-88b0-794350955614 (4076cff0-1e4a-49d6-88b0-794350955614): created successfully Sep 28 17:11:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c6727a-188f-466b-91c9-710f9eb93a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Flow 'volume_create_manager' (90b167bc-f076-40f8-84d6-1fb6af777b28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:47 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e99d4521-cd39-4998-bb5b-6cb8eaa48fb1 tempest-VolumesActionsTest-246690682 None] Created volume successfully. Sep 28 17:11:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-32d3f2f4-08a9-4fa4-9122-893ac3159fc6 tempest-VolumesActionsTest-1666652462 None] Acquiring lock "cinder-4076cff0-1e4a-49d6-88b0-794350955614-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-32d3f2f4-08a9-4fa4-9122-893ac3159fc6 tempest-VolumesActionsTest-1666652462 None] Lock "cinder-4076cff0-1e4a-49d6-88b0-794350955614-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-32d3f2f4-08a9-4fa4-9122-893ac3159fc6 tempest-VolumesActionsTest-1666652462 None] Acquiring lock "cinder-quobyte-4076cff0-1e4a-49d6-88b0-794350955614" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-32d3f2f4-08a9-4fa4-9122-893ac3159fc6 tempest-VolumesActionsTest-1666652462 None] Lock "cinder-quobyte-4076cff0-1e4a-49d6-88b0-794350955614" acquired by "delete_volume" :: waited 0.032s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:47 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0c8087-8d31-4858-ba53-9d9219d15cb1]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-32d3f2f4-08a9-4fa4-9122-893ac3159fc6 tempest-VolumesActionsTest-1666652462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4076cff0-1e4a-49d6-88b0-794350955614 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:48 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4076cff0-1e4a-49d6-88b0-794350955614 Sep 28 17:11:48 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:48 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-32d3f2f4-08a9-4fa4-9122-893ac3159fc6 tempest-VolumesActionsTest-1666652462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4076cff0-1e4a-49d6-88b0-794350955614" returned: 0 in 0.802s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-32d3f2f4-08a9-4fa4-9122-893ac3159fc6 tempest-VolumesActionsTest-1666652462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4076cff0-1e4a-49d6-88b0-794350955614 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:48 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4076cff0-1e4a-49d6-88b0-794350955614 Sep 28 17:11:48 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:49 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-32d3f2f4-08a9-4fa4-9122-893ac3159fc6 tempest-VolumesActionsTest-1666652462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4076cff0-1e4a-49d6-88b0-794350955614" returned: 0 in 0.545s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-32d3f2f4-08a9-4fa4-9122-893ac3159fc6 tempest-VolumesActionsTest-1666652462 None] Lock "cinder-quobyte-4076cff0-1e4a-49d6-88b0-794350955614" released by "delete_volume" :: held 1.438s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-32d3f2f4-08a9-4fa4-9122-893ac3159fc6 tempest-VolumesActionsTest-1666652462 None] Created reservations ['f948142c-cd77-49fd-9b19-5fd6f755782a', '88988629-60ce-4bee-9ea8-a3ba2752587e', 'ec37c9a3-431d-4921-8d62-03fff157311d', '018ad90c-e059-4765-9966-57065e243f97'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Flow 'volume_create_manager' (f660fd6e-907c-4646-9507-74bc713ed669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d4a8111-fcdb-4197-8e1f-26b847e3b22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d4a8111-fcdb-4197-8e1f-26b847e3b22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-209043296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15c164f-c22d-40c6-9646-4f80219f0ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7747767a3b654e9680b0eee5030c904a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:50Z,use_quota=True,user_id='d3abb96af6ca410688406a2bc14c5951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df7a4f0-33f3-4bae-8fea-a7581aab555a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df7a4f0-33f3-4bae-8fea-a7581aab555a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5131164-b242-4e83-9b12-773effb02ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5131164-b242-4e83-9b12-773effb02ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b15c164f-c22d-40c6-9646-4f80219f0ebe', 'volume_name': 'volume-b15c164f-c22d-40c6-9646-4f80219f0ebe', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ae5df2-1574-4c96-8732-29c7e7a44347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ae5df2-1574-4c96-8732-29c7e7a44347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf50dbe6-7b56-4a38-a52c-26e9ac51894b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:49 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Volume b15c164f-c22d-40c6-9646-4f80219f0ebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b15c164f-c22d-40c6-9646-4f80219f0ebe', 'volume_size': 1} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-209043296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15c164f-c22d-40c6-9646-4f80219f0ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7747767a3b654e9680b0eee5030c904a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:50Z,use_quota=True,user_id='d3abb96af6ca410688406a2bc14c5951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Creating volume b15c164f-c22d-40c6-9646-4f80219f0ebe {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:49 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b15c164f-c22d-40c6-9646-4f80219f0ebe 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-32d3f2f4-08a9-4fa4-9122-893ac3159fc6 tempest-VolumesActionsTest-1666652462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-32d3f2f4-08a9-4fa4-9122-893ac3159fc6 tempest-VolumesActionsTest-1666652462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-32d3f2f4-08a9-4fa4-9122-893ac3159fc6 tempest-VolumesActionsTest-1666652462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:49 devstack sudo[95958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b15c164f-c22d-40c6-9646-4f80219f0ebe 1073741824 Sep 28 17:11:49 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-32d3f2f4-08a9-4fa4-9122-893ac3159fc6 tempest-VolumesActionsTest-1666652462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-32d3f2f4-08a9-4fa4-9122-893ac3159fc6 tempest-VolumesActionsTest-1666652462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-32d3f2f4-08a9-4fa4-9122-893ac3159fc6 tempest-VolumesActionsTest-1666652462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:49 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:11:49 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:50 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-32d3f2f4-08a9-4fa4-9122-893ac3159fc6 tempest-VolumesActionsTest-1666652462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.445s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:50 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-32d3f2f4-08a9-4fa4-9122-893ac3159fc6 tempest-VolumesActionsTest-1666652462 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:50 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-32d3f2f4-08a9-4fa4-9122-893ac3159fc6 tempest-VolumesActionsTest-1666652462 None] Deleted volume successfully. Sep 28 17:11:50 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-32d3f2f4-08a9-4fa4-9122-893ac3159fc6 tempest-VolumesActionsTest-1666652462 None] Lock "cinder-4076cff0-1e4a-49d6-88b0-794350955614-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:50 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b15c164f-c22d-40c6-9646-4f80219f0ebe 1073741824" returned: 0 in 1.006s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b15c164f-c22d-40c6-9646-4f80219f0ebe {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:50 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b15c164f-c22d-40c6-9646-4f80219f0ebe Sep 28 17:11:50 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:51 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b15c164f-c22d-40c6-9646-4f80219f0ebe" returned: 0 in 0.363s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf50dbe6-7b56-4a38-a52c-26e9ac51894b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b15c164f-c22d-40c6-9646-4f80219f0ebe', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c68ca9f-64cb-47ae-9282-aacac9503c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:51 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Volume volume-b15c164f-c22d-40c6-9646-4f80219f0ebe (b15c164f-c22d-40c6-9646-4f80219f0ebe): created successfully Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c68ca9f-64cb-47ae-9282-aacac9503c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Flow 'volume_create_manager' (f660fd6e-907c-4646-9507-74bc713ed669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:51 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-11a9125f-24be-432c-b08e-2cbed26b4d67 tempest-VolumesMetadataTest-804131375 None] Created volume successfully. Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Flow 'volume_create_manager' (0180421d-e5a2-446f-a59e-dbe46bb9be02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb437829-0f46-4dd3-9a92-0b9d02911af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb437829-0f46-4dd3-9a92-0b9d02911af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-45085165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0119ac-33a4-42d9-9515-083d3603ad93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2996b0bbefc84cda990a7302f0bc70cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:51Z,use_quota=True,user_id='4906984113dd4a7f903e9202e29d6a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7568e013-cf08-498e-bff8-c58f15c80ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7568e013-cf08-498e-bff8-c58f15c80ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9b3161-7577-43b7-abda-7b3577b881c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9b3161-7577-43b7-abda-7b3577b881c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae0119ac-33a4-42d9-9515-083d3603ad93', 'volume_name': 'volume-ae0119ac-33a4-42d9-9515-083d3603ad93', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b85ffacc-503e-409a-b351-ceaf9b74c43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b85ffacc-503e-409a-b351-ceaf9b74c43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc8f348-7eef-43c9-8452-9dea8816dd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:51 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Volume ae0119ac-33a4-42d9-9515-083d3603ad93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae0119ac-33a4-42d9-9515-083d3603ad93', 'volume_size': 1} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-45085165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0119ac-33a4-42d9-9515-083d3603ad93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2996b0bbefc84cda990a7302f0bc70cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:51Z,use_quota=True,user_id='4906984113dd4a7f903e9202e29d6a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Creating volume ae0119ac-33a4-42d9-9515-083d3603ad93 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:51 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:11:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae0119ac-33a4-42d9-9515-083d3603ad93 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:51 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae0119ac-33a4-42d9-9515-083d3603ad93 1073741824 Sep 28 17:11:51 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:52 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae0119ac-33a4-42d9-9515-083d3603ad93 1073741824" returned: 0 in 0.829s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae0119ac-33a4-42d9-9515-083d3603ad93 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:52 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae0119ac-33a4-42d9-9515-083d3603ad93 Sep 28 17:11:52 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:52 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae0119ac-33a4-42d9-9515-083d3603ad93" returned: 0 in 0.457s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:52 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:52 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc8f348-7eef-43c9-8452-9dea8816dd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae0119ac-33a4-42d9-9515-083d3603ad93', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:52 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729b0e5a-3305-4439-94d2-6b7aaabf178f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:52 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Volume volume-ae0119ac-33a4-42d9-9515-083d3603ad93 (ae0119ac-33a4-42d9-9515-083d3603ad93): created successfully Sep 28 17:11:52 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729b0e5a-3305-4439-94d2-6b7aaabf178f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:52 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Flow 'volume_create_manager' (0180421d-e5a2-446f-a59e-dbe46bb9be02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:53 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-43330621-f216-45d8-8af7-79b79a88ca22 tempest-VolumesActionsTest-246690682 None] Created volume successfully. Sep 28 17:11:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-05c606fa-c903-4470-82fc-f7aa1a56af2e tempest-VolumesMetadataTest-804131375 None] Acquiring lock "cinder-b15c164f-c22d-40c6-9646-4f80219f0ebe-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-05c606fa-c903-4470-82fc-f7aa1a56af2e tempest-VolumesMetadataTest-804131375 None] Lock "cinder-b15c164f-c22d-40c6-9646-4f80219f0ebe-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-05c606fa-c903-4470-82fc-f7aa1a56af2e tempest-VolumesMetadataTest-804131375 None] Acquiring lock "cinder-quobyte-b15c164f-c22d-40c6-9646-4f80219f0ebe" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-05c606fa-c903-4470-82fc-f7aa1a56af2e tempest-VolumesMetadataTest-804131375 None] Lock "cinder-quobyte-b15c164f-c22d-40c6-9646-4f80219f0ebe" acquired by "delete_volume" :: waited 0.019s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:53 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1be9f4-dff1-4acd-9704-d5130e6b6719]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-05c606fa-c903-4470-82fc-f7aa1a56af2e tempest-VolumesMetadataTest-804131375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b15c164f-c22d-40c6-9646-4f80219f0ebe {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d437faad-d3a8-4bbf-8a2b-097fb5835da1 tempest-VolumesActionsTest-1666652462 None] Acquiring lock "cinder-ae0119ac-33a4-42d9-9515-083d3603ad93-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d437faad-d3a8-4bbf-8a2b-097fb5835da1 tempest-VolumesActionsTest-1666652462 None] Lock "cinder-ae0119ac-33a4-42d9-9515-083d3603ad93-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d437faad-d3a8-4bbf-8a2b-097fb5835da1 tempest-VolumesActionsTest-1666652462 None] Acquiring lock "cinder-quobyte-ae0119ac-33a4-42d9-9515-083d3603ad93" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d437faad-d3a8-4bbf-8a2b-097fb5835da1 tempest-VolumesActionsTest-1666652462 None] Lock "cinder-quobyte-ae0119ac-33a4-42d9-9515-083d3603ad93" acquired by "delete_volume" :: waited 0.024s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:53 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef29a5e3-5c1f-47e6-be96-06735a50c510]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d437faad-d3a8-4bbf-8a2b-097fb5835da1 tempest-VolumesActionsTest-1666652462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae0119ac-33a4-42d9-9515-083d3603ad93 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:54 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b15c164f-c22d-40c6-9646-4f80219f0ebe Sep 28 17:11:54 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:54 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae0119ac-33a4-42d9-9515-083d3603ad93 Sep 28 17:11:54 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:54 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-05c606fa-c903-4470-82fc-f7aa1a56af2e tempest-VolumesMetadataTest-804131375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b15c164f-c22d-40c6-9646-4f80219f0ebe" returned: 0 in 0.619s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-05c606fa-c903-4470-82fc-f7aa1a56af2e tempest-VolumesMetadataTest-804131375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b15c164f-c22d-40c6-9646-4f80219f0ebe {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:54 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b15c164f-c22d-40c6-9646-4f80219f0ebe Sep 28 17:11:54 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:54 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d437faad-d3a8-4bbf-8a2b-097fb5835da1 tempest-VolumesActionsTest-1666652462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae0119ac-33a4-42d9-9515-083d3603ad93" returned: 0 in 0.649s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d437faad-d3a8-4bbf-8a2b-097fb5835da1 tempest-VolumesActionsTest-1666652462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae0119ac-33a4-42d9-9515-083d3603ad93 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:54 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae0119ac-33a4-42d9-9515-083d3603ad93 Sep 28 17:11:54 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:54 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-05c606fa-c903-4470-82fc-f7aa1a56af2e tempest-VolumesMetadataTest-804131375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b15c164f-c22d-40c6-9646-4f80219f0ebe" returned: 0 in 0.431s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:54 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-05c606fa-c903-4470-82fc-f7aa1a56af2e tempest-VolumesMetadataTest-804131375 None] Lock "cinder-quobyte-b15c164f-c22d-40c6-9646-4f80219f0ebe" released by "delete_volume" :: held 1.163s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-05c606fa-c903-4470-82fc-f7aa1a56af2e tempest-VolumesMetadataTest-804131375 None] Created reservations ['4237e255-451f-4339-9ba4-07026950e8f8', 'e8a4fd40-a0fb-4824-9a18-af7e290ce55d', 'b05038bd-2c6c-4b4d-a120-0535f9cd6dc0', 'bc47b1a5-2d99-4f88-8ad7-c325f0e0e66d'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:55 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d437faad-d3a8-4bbf-8a2b-097fb5835da1 tempest-VolumesActionsTest-1666652462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae0119ac-33a4-42d9-9515-083d3603ad93" returned: 0 in 0.457s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d437faad-d3a8-4bbf-8a2b-097fb5835da1 tempest-VolumesActionsTest-1666652462 None] Lock "cinder-quobyte-ae0119ac-33a4-42d9-9515-083d3603ad93" released by "delete_volume" :: held 1.200s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-05c606fa-c903-4470-82fc-f7aa1a56af2e tempest-VolumesMetadataTest-804131375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-05c606fa-c903-4470-82fc-f7aa1a56af2e tempest-VolumesMetadataTest-804131375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-05c606fa-c903-4470-82fc-f7aa1a56af2e tempest-VolumesMetadataTest-804131375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-05c606fa-c903-4470-82fc-f7aa1a56af2e tempest-VolumesMetadataTest-804131375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-05c606fa-c903-4470-82fc-f7aa1a56af2e tempest-VolumesMetadataTest-804131375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-05c606fa-c903-4470-82fc-f7aa1a56af2e tempest-VolumesMetadataTest-804131375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-d437faad-d3a8-4bbf-8a2b-097fb5835da1 tempest-VolumesActionsTest-1666652462 None] Created reservations ['e3b18a23-a6fd-4a09-95c7-d3364d0cc1ec', '5e94b013-8ef9-4bfb-9d31-35b2f8a9125c', 'b67d3d20-3d64-4fd9-aa6e-32bbd3ec6a2b', '0790c9e1-2f2a-4e68-9ff6-a7f132f803ce'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:55 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:11:55 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d437faad-d3a8-4bbf-8a2b-097fb5835da1 tempest-VolumesActionsTest-1666652462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d437faad-d3a8-4bbf-8a2b-097fb5835da1 tempest-VolumesActionsTest-1666652462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d437faad-d3a8-4bbf-8a2b-097fb5835da1 tempest-VolumesActionsTest-1666652462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d437faad-d3a8-4bbf-8a2b-097fb5835da1 tempest-VolumesActionsTest-1666652462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d437faad-d3a8-4bbf-8a2b-097fb5835da1 tempest-VolumesActionsTest-1666652462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d437faad-d3a8-4bbf-8a2b-097fb5835da1 tempest-VolumesActionsTest-1666652462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:55 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:11:55 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Flow 'volume_create_manager' (ec70e0f2-9d22-41b5-9ac6-ad9f27d40bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb7cf9e4-b289-4753-96d1-37dda5162116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:55 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-05c606fa-c903-4470-82fc-f7aa1a56af2e tempest-VolumesMetadataTest-804131375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.405s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-05c606fa-c903-4470-82fc-f7aa1a56af2e tempest-VolumesMetadataTest-804131375 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb7cf9e4-b289-4753-96d1-37dda5162116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1795940379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c71fe63-8312-4044-b310-73ce1a70dd75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ee22bc31304da8bbed8d983a7993bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:55Z,use_quota=True,user_id='1244e8c93f9c4b31b399a9fb10687e84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bbb9a7d-a4a2-4ceb-8a9b-7a9d964305b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bbb9a7d-a4a2-4ceb-8a9b-7a9d964305b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df7940f-62b5-46b9-a8fb-5d7b462cc181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df7940f-62b5-46b9-a8fb-5d7b462cc181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c71fe63-8312-4044-b310-73ce1a70dd75', 'volume_name': 'volume-4c71fe63-8312-4044-b310-73ce1a70dd75', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc077b5c-4b31-4edc-b7d2-842328d25356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc077b5c-4b31-4edc-b7d2-842328d25356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99777b0f-5bee-413b-857f-ad8671b972a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:55 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Volume 4c71fe63-8312-4044-b310-73ce1a70dd75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c71fe63-8312-4044-b310-73ce1a70dd75', 'volume_size': 1} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1795940379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c71fe63-8312-4044-b310-73ce1a70dd75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ee22bc31304da8bbed8d983a7993bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:55Z,use_quota=True,user_id='1244e8c93f9c4b31b399a9fb10687e84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Creating volume 4c71fe63-8312-4044-b310-73ce1a70dd75 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:55 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4c71fe63-8312-4044-b310-73ce1a70dd75 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:55 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-05c606fa-c903-4470-82fc-f7aa1a56af2e tempest-VolumesMetadataTest-804131375 None] Deleted volume successfully. Sep 28 17:11:55 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-05c606fa-c903-4470-82fc-f7aa1a56af2e tempest-VolumesMetadataTest-804131375 None] Lock "cinder-b15c164f-c22d-40c6-9646-4f80219f0ebe-delete_volume" released by "delete_volume" :: held 2.161s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:55 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4c71fe63-8312-4044-b310-73ce1a70dd75 1073741824 Sep 28 17:11:55 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:56 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d437faad-d3a8-4bbf-8a2b-097fb5835da1 tempest-VolumesActionsTest-1666652462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.493s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:56 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-d437faad-d3a8-4bbf-8a2b-097fb5835da1 tempest-VolumesActionsTest-1666652462 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:56 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d437faad-d3a8-4bbf-8a2b-097fb5835da1 tempest-VolumesActionsTest-1666652462 None] Deleted volume successfully. Sep 28 17:11:56 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d437faad-d3a8-4bbf-8a2b-097fb5835da1 tempest-VolumesActionsTest-1666652462 None] Lock "cinder-ae0119ac-33a4-42d9-9515-083d3603ad93-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:56 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4c71fe63-8312-4044-b310-73ce1a70dd75 1073741824" returned: 0 in 0.854s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4c71fe63-8312-4044-b310-73ce1a70dd75 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:56 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4c71fe63-8312-4044-b310-73ce1a70dd75 Sep 28 17:11:56 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:57 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4c71fe63-8312-4044-b310-73ce1a70dd75" returned: 0 in 0.360s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99777b0f-5bee-413b-857f-ad8671b972a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c71fe63-8312-4044-b310-73ce1a70dd75', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6131f13f-e58a-4824-bcf0-88a61d0585f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:57 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Volume volume-4c71fe63-8312-4044-b310-73ce1a70dd75 (4c71fe63-8312-4044-b310-73ce1a70dd75): created successfully Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6131f13f-e58a-4824-bcf0-88a61d0585f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Flow 'volume_create_manager' (ec70e0f2-9d22-41b5-9ac6-ad9f27d40bfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:57 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-829bbf2f-a9a8-4a07-89a0-d5bfee30f30c tempest-VolumesTransfersV357Test-585061590 None] Created volume successfully. Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Flow 'volume_create_manager' (8edd14af-b102-47d0-b5d6-6cfc9e6d691f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc88232-1147-4091-911e-474a6b64a7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc88232-1147-4091-911e-474a6b64a7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1345666690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448e3836-ebc9-4c1b-a0a0-ca159372f660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2996b0bbefc84cda990a7302f0bc70cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:57Z,use_quota=True,user_id='4906984113dd4a7f903e9202e29d6a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d6aab5-24db-4cbd-84be-4020974d21cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d6aab5-24db-4cbd-84be-4020974d21cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a34da95-b5bd-4b4c-8da4-d39f6354c277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a34da95-b5bd-4b4c-8da4-d39f6354c277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '448e3836-ebc9-4c1b-a0a0-ca159372f660', 'volume_name': 'volume-448e3836-ebc9-4c1b-a0a0-ca159372f660', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd29448d-0b8d-4c48-b0ae-68eea92dcdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd29448d-0b8d-4c48-b0ae-68eea92dcdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ccd5b1c-b1b1-4d81-b5df-738511f4a954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:57 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Volume 448e3836-ebc9-4c1b-a0a0-ca159372f660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-448e3836-ebc9-4c1b-a0a0-ca159372f660', 'volume_size': 1} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1345666690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448e3836-ebc9-4c1b-a0a0-ca159372f660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2996b0bbefc84cda990a7302f0bc70cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:57Z,use_quota=True,user_id='4906984113dd4a7f903e9202e29d6a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Creating volume 448e3836-ebc9-4c1b-a0a0-ca159372f660 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:57 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:11:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-448e3836-ebc9-4c1b-a0a0-ca159372f660 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:57 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-448e3836-ebc9-4c1b-a0a0-ca159372f660 1073741824 Sep 28 17:11:57 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:58 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-448e3836-ebc9-4c1b-a0a0-ca159372f660 1073741824" returned: 0 in 0.651s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-448e3836-ebc9-4c1b-a0a0-ca159372f660 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:58 devstack sudo[96065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-448e3836-ebc9-4c1b-a0a0-ca159372f660 Sep 28 17:11:58 devstack sudo[96065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:58 devstack sudo[96065]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-448e3836-ebc9-4c1b-a0a0-ca159372f660" returned: 0 in 0.427s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ccd5b1c-b1b1-4d81-b5df-738511f4a954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-448e3836-ebc9-4c1b-a0a0-ca159372f660', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08379503-d406-4eef-8c7a-486a367b5d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:58 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Volume volume-448e3836-ebc9-4c1b-a0a0-ca159372f660 (448e3836-ebc9-4c1b-a0a0-ca159372f660): created successfully Sep 28 17:11:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08379503-d406-4eef-8c7a-486a367b5d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Flow 'volume_create_manager' (8edd14af-b102-47d0-b5d6-6cfc9e6d691f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:58 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-3e96f7aa-4963-4e35-8fcb-2b164a344612 tempest-VolumesActionsTest-246690682 None] Created volume successfully. Sep 28 17:11:59 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-4afc031f-c551-414e-a3dd-6d2185e6eaaf tempest-VolumesTransfersV357Test-1113644975 None] Transfer volume completed successfully. Sep 28 17:11:59 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a78e0acb-4740-439a-bcc1-e1c7be727b58 tempest-VolumesActionsTest-1666652462 None] Acquiring lock "cinder-448e3836-ebc9-4c1b-a0a0-ca159372f660-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:59 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a78e0acb-4740-439a-bcc1-e1c7be727b58 tempest-VolumesActionsTest-1666652462 None] Lock "cinder-448e3836-ebc9-4c1b-a0a0-ca159372f660-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:59 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a78e0acb-4740-439a-bcc1-e1c7be727b58 tempest-VolumesActionsTest-1666652462 None] Acquiring lock "cinder-quobyte-448e3836-ebc9-4c1b-a0a0-ca159372f660" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:59 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a78e0acb-4740-439a-bcc1-e1c7be727b58 tempest-VolumesActionsTest-1666652462 None] Lock "cinder-quobyte-448e3836-ebc9-4c1b-a0a0-ca159372f660" acquired by "delete_volume" :: waited 0.019s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:59 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[34696903-49e2-4965-8eba-1cf440d0ff9b]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a78e0acb-4740-439a-bcc1-e1c7be727b58 tempest-VolumesActionsTest-1666652462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-448e3836-ebc9-4c1b-a0a0-ca159372f660 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:00 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-448e3836-ebc9-4c1b-a0a0-ca159372f660 Sep 28 17:12:00 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4b505109-9d7b-4aa2-aaf9-bde710224455 tempest-VolumesTransfersV357Test-1039027017 None] Acquiring lock "cinder-4c71fe63-8312-4044-b310-73ce1a70dd75-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4b505109-9d7b-4aa2-aaf9-bde710224455 tempest-VolumesTransfersV357Test-1039027017 None] Lock "cinder-4c71fe63-8312-4044-b310-73ce1a70dd75-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:00 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a78e0acb-4740-439a-bcc1-e1c7be727b58 tempest-VolumesActionsTest-1666652462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-448e3836-ebc9-4c1b-a0a0-ca159372f660" returned: 0 in 0.553s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a78e0acb-4740-439a-bcc1-e1c7be727b58 tempest-VolumesActionsTest-1666652462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-448e3836-ebc9-4c1b-a0a0-ca159372f660 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4b505109-9d7b-4aa2-aaf9-bde710224455 tempest-VolumesTransfersV357Test-1039027017 None] Acquiring lock "cinder-quobyte-4c71fe63-8312-4044-b310-73ce1a70dd75" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4b505109-9d7b-4aa2-aaf9-bde710224455 tempest-VolumesTransfersV357Test-1039027017 None] Lock "cinder-quobyte-4c71fe63-8312-4044-b310-73ce1a70dd75" acquired by "delete_volume" :: waited 0.026s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:00 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-448e3836-ebc9-4c1b-a0a0-ca159372f660 Sep 28 17:12:00 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:00 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd10edd0-fd73-4973-8df0-c59e7607872d]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4b505109-9d7b-4aa2-aaf9-bde710224455 tempest-VolumesTransfersV357Test-1039027017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4c71fe63-8312-4044-b310-73ce1a70dd75 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:00 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4c71fe63-8312-4044-b310-73ce1a70dd75 Sep 28 17:12:00 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:00 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a78e0acb-4740-439a-bcc1-e1c7be727b58 tempest-VolumesActionsTest-1666652462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-448e3836-ebc9-4c1b-a0a0-ca159372f660" returned: 0 in 0.343s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a78e0acb-4740-439a-bcc1-e1c7be727b58 tempest-VolumesActionsTest-1666652462 None] Lock "cinder-quobyte-448e3836-ebc9-4c1b-a0a0-ca159372f660" released by "delete_volume" :: held 0.955s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:00 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-a78e0acb-4740-439a-bcc1-e1c7be727b58 tempest-VolumesActionsTest-1666652462 None] Created reservations ['445af2df-3d29-41cb-a396-889c207cc0ac', '7c203864-2c08-46b5-ad95-e730ebfba8b1', 'b849f8df-9342-438e-886a-608035448eb1', '6482b06d-3c98-47f8-87a7-5b050218e6bc'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a78e0acb-4740-439a-bcc1-e1c7be727b58 tempest-VolumesActionsTest-1666652462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a78e0acb-4740-439a-bcc1-e1c7be727b58 tempest-VolumesActionsTest-1666652462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a78e0acb-4740-439a-bcc1-e1c7be727b58 tempest-VolumesActionsTest-1666652462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a78e0acb-4740-439a-bcc1-e1c7be727b58 tempest-VolumesActionsTest-1666652462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a78e0acb-4740-439a-bcc1-e1c7be727b58 tempest-VolumesActionsTest-1666652462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a78e0acb-4740-439a-bcc1-e1c7be727b58 tempest-VolumesActionsTest-1666652462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:01 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:12:01 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:01 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4b505109-9d7b-4aa2-aaf9-bde710224455 tempest-VolumesTransfersV357Test-1039027017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4c71fe63-8312-4044-b310-73ce1a70dd75" returned: 0 in 0.656s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4b505109-9d7b-4aa2-aaf9-bde710224455 tempest-VolumesTransfersV357Test-1039027017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4c71fe63-8312-4044-b310-73ce1a70dd75 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:01 devstack sudo[96095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4c71fe63-8312-4044-b310-73ce1a70dd75 Sep 28 17:12:01 devstack sudo[96095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:01 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a78e0acb-4740-439a-bcc1-e1c7be727b58 tempest-VolumesActionsTest-1666652462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.567s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:01 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-a78e0acb-4740-439a-bcc1-e1c7be727b58 tempest-VolumesActionsTest-1666652462 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:01 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a78e0acb-4740-439a-bcc1-e1c7be727b58 tempest-VolumesActionsTest-1666652462 None] Deleted volume successfully. Sep 28 17:12:01 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a78e0acb-4740-439a-bcc1-e1c7be727b58 tempest-VolumesActionsTest-1666652462 None] Lock "cinder-448e3836-ebc9-4c1b-a0a0-ca159372f660-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:01 devstack sudo[96095]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4b505109-9d7b-4aa2-aaf9-bde710224455 tempest-VolumesTransfersV357Test-1039027017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4c71fe63-8312-4044-b310-73ce1a70dd75" returned: 0 in 0.550s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:01 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4b505109-9d7b-4aa2-aaf9-bde710224455 tempest-VolumesTransfersV357Test-1039027017 None] Lock "cinder-quobyte-4c71fe63-8312-4044-b310-73ce1a70dd75" released by "delete_volume" :: held 1.268s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:01 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-4b505109-9d7b-4aa2-aaf9-bde710224455 tempest-VolumesTransfersV357Test-1039027017 None] Created reservations ['d8c2b513-f5bf-47d2-af1b-9afc87c2aa92', 'a4b75e19-ac58-4aa8-adeb-968117dea09a', 'fba7f78a-a603-4e44-ad0a-dc0322045fea', '73548955-d8ed-462e-a409-3a14da8e773d'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4b505109-9d7b-4aa2-aaf9-bde710224455 tempest-VolumesTransfersV357Test-1039027017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4b505109-9d7b-4aa2-aaf9-bde710224455 tempest-VolumesTransfersV357Test-1039027017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4b505109-9d7b-4aa2-aaf9-bde710224455 tempest-VolumesTransfersV357Test-1039027017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4b505109-9d7b-4aa2-aaf9-bde710224455 tempest-VolumesTransfersV357Test-1039027017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4b505109-9d7b-4aa2-aaf9-bde710224455 tempest-VolumesTransfersV357Test-1039027017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4b505109-9d7b-4aa2-aaf9-bde710224455 tempest-VolumesTransfersV357Test-1039027017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:02 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:12:02 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:02 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4b505109-9d7b-4aa2-aaf9-bde710224455 tempest-VolumesTransfersV357Test-1039027017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.412s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:02 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-4b505109-9d7b-4aa2-aaf9-bde710224455 tempest-VolumesTransfersV357Test-1039027017 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:02 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-4b505109-9d7b-4aa2-aaf9-bde710224455 tempest-VolumesTransfersV357Test-1039027017 None] Deleted volume successfully. Sep 28 17:12:02 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4b505109-9d7b-4aa2-aaf9-bde710224455 tempest-VolumesTransfersV357Test-1039027017 None] Lock "cinder-4c71fe63-8312-4044-b310-73ce1a70dd75-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Flow 'volume_create_manager' (dd649b46-908f-42d2-8a70-87df176decd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36496a8e-86e3-4f17-b5b0-708f90cff20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36496a8e-86e3-4f17-b5b0-708f90cff20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1238478242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1935796d-41df-4298-ad9a-36bc2847d0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2996b0bbefc84cda990a7302f0bc70cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:03Z,use_quota=True,user_id='4906984113dd4a7f903e9202e29d6a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511a23c9-9cd8-4e0f-a6ac-4a7c015c1a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511a23c9-9cd8-4e0f-a6ac-4a7c015c1a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10834c85-af56-495b-af59-ac16ca752155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10834c85-af56-495b-af59-ac16ca752155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1935796d-41df-4298-ad9a-36bc2847d0d4', 'volume_name': 'volume-1935796d-41df-4298-ad9a-36bc2847d0d4', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ebac59f-79af-4dca-b0ee-25d9a6099067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ebac59f-79af-4dca-b0ee-25d9a6099067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eda492b-f029-4310-be0d-1c0178ced436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:03 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Volume 1935796d-41df-4298-ad9a-36bc2847d0d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1935796d-41df-4298-ad9a-36bc2847d0d4', 'volume_size': 1} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1238478242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1935796d-41df-4298-ad9a-36bc2847d0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2996b0bbefc84cda990a7302f0bc70cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:03Z,use_quota=True,user_id='4906984113dd4a7f903e9202e29d6a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Creating volume 1935796d-41df-4298-ad9a-36bc2847d0d4 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:03 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1935796d-41df-4298-ad9a-36bc2847d0d4 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:03 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1935796d-41df-4298-ad9a-36bc2847d0d4 1073741824 Sep 28 17:12:03 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Flow 'volume_create_manager' (ad7cce0f-66b6-4071-97ff-1dc1c909a80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f787429-1551-48f0-a4dd-ff889a5a5c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f787429-1551-48f0-a4dd-ff889a5a5c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1912621212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca657ed4-ab37-4f84-911e-9086cb706f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ee22bc31304da8bbed8d983a7993bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:04Z,use_quota=True,user_id='1244e8c93f9c4b31b399a9fb10687e84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe5f3a6-9362-4eae-901c-7158838fd2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe5f3a6-9362-4eae-901c-7158838fd2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec1bf42-6d13-48c4-b31a-4ff3b6169216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec1bf42-6d13-48c4-b31a-4ff3b6169216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca657ed4-ab37-4f84-911e-9086cb706f14', 'volume_name': 'volume-ca657ed4-ab37-4f84-911e-9086cb706f14', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01c0fdf-6367-4743-99de-00c06a49585b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01c0fdf-6367-4743-99de-00c06a49585b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693c8be1-6cb1-4f19-9163-4cf6dfb6f032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:03 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Volume ca657ed4-ab37-4f84-911e-9086cb706f14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca657ed4-ab37-4f84-911e-9086cb706f14', 'volume_size': 1} Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:03 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1935796d-41df-4298-ad9a-36bc2847d0d4 1073741824" returned: 0 in 0.759s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1935796d-41df-4298-ad9a-36bc2847d0d4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:04 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1935796d-41df-4298-ad9a-36bc2847d0d4 Sep 28 17:12:04 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:04 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1935796d-41df-4298-ad9a-36bc2847d0d4" returned: 0 in 0.361s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.633s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1912621212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca657ed4-ab37-4f84-911e-9086cb706f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ee22bc31304da8bbed8d983a7993bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:04Z,use_quota=True,user_id='1244e8c93f9c4b31b399a9fb10687e84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Creating volume ca657ed4-ab37-4f84-911e-9086cb706f14 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:04 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:12:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ca657ed4-ab37-4f84-911e-9086cb706f14 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eda492b-f029-4310-be0d-1c0178ced436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1935796d-41df-4298-ad9a-36bc2847d0d4', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3207c114-7b18-44bb-981e-f18e7559afa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:04 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Volume volume-1935796d-41df-4298-ad9a-36bc2847d0d4 (1935796d-41df-4298-ad9a-36bc2847d0d4): created successfully Sep 28 17:12:04 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ca657ed4-ab37-4f84-911e-9086cb706f14 1073741824 Sep 28 17:12:04 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3207c114-7b18-44bb-981e-f18e7559afa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Flow 'volume_create_manager' (dd649b46-908f-42d2-8a70-87df176decd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:04 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-fe8146e2-d16f-4a66-a447-67bc9b5a4245 tempest-VolumesActionsTest-246690682 None] Created volume successfully. Sep 28 17:12:05 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ca657ed4-ab37-4f84-911e-9086cb706f14 1073741824" returned: 0 in 0.781s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ca657ed4-ab37-4f84-911e-9086cb706f14 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:05 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ca657ed4-ab37-4f84-911e-9086cb706f14 Sep 28 17:12:05 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Flow 'volume_create_manager' (109d29fd-b0aa-4275-ac6a-b9478ad9bbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33dc41bc-3357-4834-9bef-66b0f3146a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33dc41bc-3357-4834-9bef-66b0f3146a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-430909329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51debc8d-d89d-44a1-889c-cc11ad1278f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd316c618e38440397517ac76e598257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:05Z,use_quota=True,user_id='4e34fb6c8594458a85bc08e562a00f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dcbdf2c-aebc-418a-9963-d4a6f130b47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dcbdf2c-aebc-418a-9963-d4a6f130b47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4fef0c-6b68-41a5-8624-44edc28a813d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4fef0c-6b68-41a5-8624-44edc28a813d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51debc8d-d89d-44a1-889c-cc11ad1278f6', 'volume_name': 'volume-51debc8d-d89d-44a1-889c-cc11ad1278f6', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52e343e-e053-4aed-bf97-c10793686ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52e343e-e053-4aed-bf97-c10793686ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c529fe4d-4cda-45d1-93a6-2f156288a365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:05 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Volume 51debc8d-d89d-44a1-889c-cc11ad1278f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51debc8d-d89d-44a1-889c-cc11ad1278f6', 'volume_size': 1} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2f2d3e18-c3f7-4dbc-a73c-ecc8fbd2cb6a tempest-VolumesActionsTest-1666652462 None] Acquiring lock "cinder-1935796d-41df-4298-ad9a-36bc2847d0d4-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2f2d3e18-c3f7-4dbc-a73c-ecc8fbd2cb6a tempest-VolumesActionsTest-1666652462 None] Lock "cinder-1935796d-41df-4298-ad9a-36bc2847d0d4-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:05 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2f2d3e18-c3f7-4dbc-a73c-ecc8fbd2cb6a tempest-VolumesActionsTest-1666652462 None] Acquiring lock "cinder-quobyte-1935796d-41df-4298-ad9a-36bc2847d0d4" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ca657ed4-ab37-4f84-911e-9086cb706f14" returned: 0 in 0.413s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.166s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-430909329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51debc8d-d89d-44a1-889c-cc11ad1278f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd316c618e38440397517ac76e598257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:05Z,use_quota=True,user_id='4e34fb6c8594458a85bc08e562a00f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Creating volume 51debc8d-d89d-44a1-889c-cc11ad1278f6 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:05 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-51debc8d-d89d-44a1-889c-cc11ad1278f6 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:05 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-51debc8d-d89d-44a1-889c-cc11ad1278f6 1073741824 Sep 28 17:12:05 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693c8be1-6cb1-4f19-9163-4cf6dfb6f032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca657ed4-ab37-4f84-911e-9086cb706f14', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f04f51d-17e0-4de6-8a53-217669165955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2f2d3e18-c3f7-4dbc-a73c-ecc8fbd2cb6a tempest-VolumesActionsTest-1666652462 None] Lock "cinder-quobyte-1935796d-41df-4298-ad9a-36bc2847d0d4" acquired by "delete_volume" :: waited 0.080s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:05 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Volume volume-ca657ed4-ab37-4f84-911e-9086cb706f14 (ca657ed4-ab37-4f84-911e-9086cb706f14): created successfully Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f04f51d-17e0-4de6-8a53-217669165955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Flow 'volume_create_manager' (ad7cce0f-66b6-4071-97ff-1dc1c909a80d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb58496d-5853-45d8-9835-262ec77578b7]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2f2d3e18-c3f7-4dbc-a73c-ecc8fbd2cb6a tempest-VolumesActionsTest-1666652462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1935796d-41df-4298-ad9a-36bc2847d0d4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:05 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-cb270231-7032-4ef9-a179-bd768fafd9c2 tempest-VolumesTransfersV357Test-585061590 None] Created volume successfully. Sep 28 17:12:05 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1935796d-41df-4298-ad9a-36bc2847d0d4 Sep 28 17:12:05 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:06 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-51debc8d-d89d-44a1-889c-cc11ad1278f6 1073741824" returned: 0 in 0.601s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-51debc8d-d89d-44a1-889c-cc11ad1278f6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:06 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2f2d3e18-c3f7-4dbc-a73c-ecc8fbd2cb6a tempest-VolumesActionsTest-1666652462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1935796d-41df-4298-ad9a-36bc2847d0d4" returned: 0 in 0.537s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2f2d3e18-c3f7-4dbc-a73c-ecc8fbd2cb6a tempest-VolumesActionsTest-1666652462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1935796d-41df-4298-ad9a-36bc2847d0d4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:06 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-51debc8d-d89d-44a1-889c-cc11ad1278f6 Sep 28 17:12:06 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:06 devstack sudo[96158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1935796d-41df-4298-ad9a-36bc2847d0d4 Sep 28 17:12:06 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:06 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:06 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2f2d3e18-c3f7-4dbc-a73c-ecc8fbd2cb6a tempest-VolumesActionsTest-1666652462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1935796d-41df-4298-ad9a-36bc2847d0d4" returned: 0 in 0.347s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-51debc8d-d89d-44a1-889c-cc11ad1278f6" returned: 0 in 0.365s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2f2d3e18-c3f7-4dbc-a73c-ecc8fbd2cb6a tempest-VolumesActionsTest-1666652462 None] Lock "cinder-quobyte-1935796d-41df-4298-ad9a-36bc2847d0d4" released by "delete_volume" :: held 0.998s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:12:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c529fe4d-4cda-45d1-93a6-2f156288a365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51debc8d-d89d-44a1-889c-cc11ad1278f6', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80a6563-ce25-418e-9092-79fa13fc437e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:06 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:12:06 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:06 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Volume volume-51debc8d-d89d-44a1-889c-cc11ad1278f6 (51debc8d-d89d-44a1-889c-cc11ad1278f6): created successfully Sep 28 17:12:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80a6563-ce25-418e-9092-79fa13fc437e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Flow 'volume_create_manager' (109d29fd-b0aa-4275-ac6a-b9478ad9bbb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:06 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-31cdc72e-2516-4107-827b-1f8249b62cb8 tempest-VolumesTransfersTest-1320399678 None] Created volume successfully. Sep 28 17:12:06 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-2f2d3e18-c3f7-4dbc-a73c-ecc8fbd2cb6a tempest-VolumesActionsTest-1666652462 None] Created reservations ['34dc88dd-a7b9-43ac-9bf1-560d1f21568f', '1afcb0f1-384e-41bf-b675-0c963fe90164', 'd313dd57-5ed4-40ce-bdcc-aced958b203f', '078cffc4-2960-404f-85be-2116ee412438'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2f2d3e18-c3f7-4dbc-a73c-ecc8fbd2cb6a tempest-VolumesActionsTest-1666652462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2f2d3e18-c3f7-4dbc-a73c-ecc8fbd2cb6a tempest-VolumesActionsTest-1666652462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2f2d3e18-c3f7-4dbc-a73c-ecc8fbd2cb6a tempest-VolumesActionsTest-1666652462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2f2d3e18-c3f7-4dbc-a73c-ecc8fbd2cb6a tempest-VolumesActionsTest-1666652462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2f2d3e18-c3f7-4dbc-a73c-ecc8fbd2cb6a tempest-VolumesActionsTest-1666652462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2f2d3e18-c3f7-4dbc-a73c-ecc8fbd2cb6a tempest-VolumesActionsTest-1666652462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:07 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:12:07 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:07 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.473s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:12:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:12:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:12:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-264a2fa0-f31f-449c-b410-4a96832ff45d tempest-VolumesTransfersV357Test-1039027017 None] Acquiring lock "cinder-ca657ed4-ab37-4f84-911e-9086cb706f14-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-264a2fa0-f31f-449c-b410-4a96832ff45d tempest-VolumesTransfersV357Test-1039027017 None] Lock "cinder-ca657ed4-ab37-4f84-911e-9086cb706f14-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-264a2fa0-f31f-449c-b410-4a96832ff45d tempest-VolumesTransfersV357Test-1039027017 None] Acquiring lock "cinder-quobyte-ca657ed4-ab37-4f84-911e-9086cb706f14" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-264a2fa0-f31f-449c-b410-4a96832ff45d tempest-VolumesTransfersV357Test-1039027017 None] Lock "cinder-quobyte-ca657ed4-ab37-4f84-911e-9086cb706f14" acquired by "delete_volume" :: waited 0.038s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:07 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2f2d3e18-c3f7-4dbc-a73c-ecc8fbd2cb6a tempest-VolumesActionsTest-1666652462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.505s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-2f2d3e18-c3f7-4dbc-a73c-ecc8fbd2cb6a tempest-VolumesActionsTest-1666652462 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:07 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[236b57d4-4b65-433b-a111-df2242463dfb]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-264a2fa0-f31f-449c-b410-4a96832ff45d tempest-VolumesTransfersV357Test-1039027017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ca657ed4-ab37-4f84-911e-9086cb706f14 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:07 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-2f2d3e18-c3f7-4dbc-a73c-ecc8fbd2cb6a tempest-VolumesActionsTest-1666652462 None] Deleted volume successfully. Sep 28 17:12:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2f2d3e18-c3f7-4dbc-a73c-ecc8fbd2cb6a tempest-VolumesActionsTest-1666652462 None] Lock "cinder-1935796d-41df-4298-ad9a-36bc2847d0d4-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:07 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ca657ed4-ab37-4f84-911e-9086cb706f14 Sep 28 17:12:07 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:08 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-264a2fa0-f31f-449c-b410-4a96832ff45d tempest-VolumesTransfersV357Test-1039027017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ca657ed4-ab37-4f84-911e-9086cb706f14" returned: 0 in 0.592s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-264a2fa0-f31f-449c-b410-4a96832ff45d tempest-VolumesTransfersV357Test-1039027017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ca657ed4-ab37-4f84-911e-9086cb706f14 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:08 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ca657ed4-ab37-4f84-911e-9086cb706f14 Sep 28 17:12:08 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:08 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-264a2fa0-f31f-449c-b410-4a96832ff45d tempest-VolumesTransfersV357Test-1039027017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ca657ed4-ab37-4f84-911e-9086cb706f14" returned: 0 in 0.514s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:08 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-b3e07cc8-dee8-4d2b-b647-0c0f8f7023a0 tempest-VolumesTransfersTest-789131460 None] Transfer volume completed successfully. Sep 28 17:12:08 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-264a2fa0-f31f-449c-b410-4a96832ff45d tempest-VolumesTransfersV357Test-1039027017 None] Lock "cinder-quobyte-ca657ed4-ab37-4f84-911e-9086cb706f14" released by "delete_volume" :: held 1.183s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:08 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-264a2fa0-f31f-449c-b410-4a96832ff45d tempest-VolumesTransfersV357Test-1039027017 None] Created reservations ['235c4b85-1525-411e-be5c-cd40f703fa05', '9b3cd0e9-a25b-46c2-bc45-7a1b0ecf7b47', 'db99e5b5-8a2f-4d67-b6fb-9f09f6091520', 'c4a222da-ea04-4796-9950-5bcfb6b893c0'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:08 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Flow 'volume_create_manager' (2408b0aa-2c7e-411c-92e1-71ad30bfc248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383032a4-bc2e-4c70-ace5-6efda51a30ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383032a4-bc2e-4c70-ace5-6efda51a30ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2097515800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e077155-ef4c-4cdb-996d-8768f1e4d514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2996b0bbefc84cda990a7302f0bc70cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:09Z,use_quota=True,user_id='4906984113dd4a7f903e9202e29d6a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c987199d-8e47-4d62-b31b-718322e67123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c987199d-8e47-4d62-b31b-718322e67123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750f5860-36c1-42bf-9dd7-f0dd7b88dd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750f5860-36c1-42bf-9dd7-f0dd7b88dd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e077155-ef4c-4cdb-996d-8768f1e4d514', 'volume_name': 'volume-7e077155-ef4c-4cdb-996d-8768f1e4d514', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c8b7ad-1564-4062-bc30-afe4b7226a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c8b7ad-1564-4062-bc30-afe4b7226a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f459c1e9-6193-44f2-bea2-2aab8ccf51e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:09 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Volume 7e077155-ef4c-4cdb-996d-8768f1e4d514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e077155-ef4c-4cdb-996d-8768f1e4d514', 'volume_size': 1} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2097515800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e077155-ef4c-4cdb-996d-8768f1e4d514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2996b0bbefc84cda990a7302f0bc70cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:09Z,use_quota=True,user_id='4906984113dd4a7f903e9202e29d6a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Creating volume 7e077155-ef4c-4cdb-996d-8768f1e4d514 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:09 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e077155-ef4c-4cdb-996d-8768f1e4d514 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-264a2fa0-f31f-449c-b410-4a96832ff45d tempest-VolumesTransfersV357Test-1039027017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-264a2fa0-f31f-449c-b410-4a96832ff45d tempest-VolumesTransfersV357Test-1039027017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-264a2fa0-f31f-449c-b410-4a96832ff45d tempest-VolumesTransfersV357Test-1039027017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-264a2fa0-f31f-449c-b410-4a96832ff45d tempest-VolumesTransfersV357Test-1039027017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-264a2fa0-f31f-449c-b410-4a96832ff45d tempest-VolumesTransfersV357Test-1039027017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-264a2fa0-f31f-449c-b410-4a96832ff45d tempest-VolumesTransfersV357Test-1039027017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:09 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e077155-ef4c-4cdb-996d-8768f1e4d514 1073741824 Sep 28 17:12:09 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:09 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:12:09 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:09 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-264a2fa0-f31f-449c-b410-4a96832ff45d tempest-VolumesTransfersV357Test-1039027017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.393s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-264a2fa0-f31f-449c-b410-4a96832ff45d tempest-VolumesTransfersV357Test-1039027017 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:09 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-264a2fa0-f31f-449c-b410-4a96832ff45d tempest-VolumesTransfersV357Test-1039027017 None] Deleted volume successfully. Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7006fb83-327e-4d09-9c6c-8b6da774fb2e tempest-VolumesTransfersTest-2121217390 None] Acquiring lock "cinder-51debc8d-d89d-44a1-889c-cc11ad1278f6-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-264a2fa0-f31f-449c-b410-4a96832ff45d tempest-VolumesTransfersV357Test-1039027017 None] Lock "cinder-ca657ed4-ab37-4f84-911e-9086cb706f14-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7006fb83-327e-4d09-9c6c-8b6da774fb2e tempest-VolumesTransfersTest-2121217390 None] Lock "cinder-51debc8d-d89d-44a1-889c-cc11ad1278f6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7006fb83-327e-4d09-9c6c-8b6da774fb2e tempest-VolumesTransfersTest-2121217390 None] Acquiring lock "cinder-quobyte-51debc8d-d89d-44a1-889c-cc11ad1278f6" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:09 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e077155-ef4c-4cdb-996d-8768f1e4d514 1073741824" returned: 0 in 0.602s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7006fb83-327e-4d09-9c6c-8b6da774fb2e tempest-VolumesTransfersTest-2121217390 None] Lock "cinder-quobyte-51debc8d-d89d-44a1-889c-cc11ad1278f6" acquired by "delete_volume" :: waited 0.026s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caec80c-4839-47ac-af8d-1aec33bdf1f2]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7006fb83-327e-4d09-9c6c-8b6da774fb2e tempest-VolumesTransfersTest-2121217390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-51debc8d-d89d-44a1-889c-cc11ad1278f6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e077155-ef4c-4cdb-996d-8768f1e4d514 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:09 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e077155-ef4c-4cdb-996d-8768f1e4d514 Sep 28 17:12:09 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:09 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-51debc8d-d89d-44a1-889c-cc11ad1278f6 Sep 28 17:12:09 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:10 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e077155-ef4c-4cdb-996d-8768f1e4d514" returned: 0 in 0.372s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f459c1e9-6193-44f2-bea2-2aab8ccf51e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e077155-ef4c-4cdb-996d-8768f1e4d514', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a83ad4-99f6-4d97-84e2-eff8b486cd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:10 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Volume volume-7e077155-ef4c-4cdb-996d-8768f1e4d514 (7e077155-ef4c-4cdb-996d-8768f1e4d514): created successfully Sep 28 17:12:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a83ad4-99f6-4d97-84e2-eff8b486cd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Flow 'volume_create_manager' (2408b0aa-2c7e-411c-92e1-71ad30bfc248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:10 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7006fb83-327e-4d09-9c6c-8b6da774fb2e tempest-VolumesTransfersTest-2121217390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-51debc8d-d89d-44a1-889c-cc11ad1278f6" returned: 0 in 0.477s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7006fb83-327e-4d09-9c6c-8b6da774fb2e tempest-VolumesTransfersTest-2121217390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-51debc8d-d89d-44a1-889c-cc11ad1278f6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:10 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-1aa0890e-9f44-47da-83c6-28f829d997cd tempest-VolumesActionsTest-246690682 None] Created volume successfully. Sep 28 17:12:10 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-51debc8d-d89d-44a1-889c-cc11ad1278f6 Sep 28 17:12:10 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:10 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7006fb83-327e-4d09-9c6c-8b6da774fb2e tempest-VolumesTransfersTest-2121217390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-51debc8d-d89d-44a1-889c-cc11ad1278f6" returned: 0 in 0.275s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7006fb83-327e-4d09-9c6c-8b6da774fb2e tempest-VolumesTransfersTest-2121217390 None] Lock "cinder-quobyte-51debc8d-d89d-44a1-889c-cc11ad1278f6" released by "delete_volume" :: held 0.804s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:10 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-7006fb83-327e-4d09-9c6c-8b6da774fb2e tempest-VolumesTransfersTest-2121217390 None] Created reservations ['2b5122d9-8876-48a2-b6d7-4ca9855c34ad', '66990310-af01-4cf7-b065-2b6b4e511d7d', 'c5fd6366-9447-4530-9ce5-5c7f73076495', '3dac38d5-9ff7-480d-b7d0-f6d1882b2a7a'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7006fb83-327e-4d09-9c6c-8b6da774fb2e tempest-VolumesTransfersTest-2121217390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7006fb83-327e-4d09-9c6c-8b6da774fb2e tempest-VolumesTransfersTest-2121217390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7006fb83-327e-4d09-9c6c-8b6da774fb2e tempest-VolumesTransfersTest-2121217390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7006fb83-327e-4d09-9c6c-8b6da774fb2e tempest-VolumesTransfersTest-2121217390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7006fb83-327e-4d09-9c6c-8b6da774fb2e tempest-VolumesTransfersTest-2121217390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7006fb83-327e-4d09-9c6c-8b6da774fb2e tempest-VolumesTransfersTest-2121217390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:10 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:12:10 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:11 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7006fb83-327e-4d09-9c6c-8b6da774fb2e tempest-VolumesTransfersTest-2121217390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.424s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-7006fb83-327e-4d09-9c6c-8b6da774fb2e tempest-VolumesTransfersTest-2121217390 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:11 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-7006fb83-327e-4d09-9c6c-8b6da774fb2e tempest-VolumesTransfersTest-2121217390 None] Deleted volume successfully. Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7006fb83-327e-4d09-9c6c-8b6da774fb2e tempest-VolumesTransfersTest-2121217390 None] Lock "cinder-51debc8d-d89d-44a1-889c-cc11ad1278f6-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Flow 'volume_create_manager' (3184c5af-ff0c-48f5-9c7d-31c06d3b8161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee38ad7e-d18f-4a5f-b0a0-120090edc8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee38ad7e-d18f-4a5f-b0a0-120090edc8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-113976491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dae7b2e-1a26-4b1e-ad2b-3363462b74d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd316c618e38440397517ac76e598257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:11Z,use_quota=True,user_id='4e34fb6c8594458a85bc08e562a00f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1754c0f4-c13b-49e6-8444-2d9bb65f075a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1754c0f4-c13b-49e6-8444-2d9bb65f075a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201aa93e-00c9-45b6-a0e5-35c85d848eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201aa93e-00c9-45b6-a0e5-35c85d848eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dae7b2e-1a26-4b1e-ad2b-3363462b74d4', 'volume_name': 'volume-2dae7b2e-1a26-4b1e-ad2b-3363462b74d4', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33eb25c0-6648-42d7-916e-3ce4f1933e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33eb25c0-6648-42d7-916e-3ce4f1933e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0988b80f-90df-4a4f-939a-79d050103b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:11 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Volume 2dae7b2e-1a26-4b1e-ad2b-3363462b74d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dae7b2e-1a26-4b1e-ad2b-3363462b74d4', 'volume_size': 1} Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-113976491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dae7b2e-1a26-4b1e-ad2b-3363462b74d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd316c618e38440397517ac76e598257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:11Z,use_quota=True,user_id='4e34fb6c8594458a85bc08e562a00f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Creating volume 2dae7b2e-1a26-4b1e-ad2b-3363462b74d4 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:11 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:12:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2dae7b2e-1a26-4b1e-ad2b-3363462b74d4 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:11 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2dae7b2e-1a26-4b1e-ad2b-3363462b74d4 1073741824 Sep 28 17:12:11 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5460a82d-315b-4efc-bb78-cf3b518446c4 tempest-VolumesActionsTest-246690682 None] Acquiring lock "cinder-7e077155-ef4c-4cdb-996d-8768f1e4d514-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5460a82d-315b-4efc-bb78-cf3b518446c4 tempest-VolumesActionsTest-246690682 None] Lock "cinder-7e077155-ef4c-4cdb-996d-8768f1e4d514-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5460a82d-315b-4efc-bb78-cf3b518446c4 tempest-VolumesActionsTest-246690682 None] Acquiring lock "cinder-quobyte-7e077155-ef4c-4cdb-996d-8768f1e4d514" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5460a82d-315b-4efc-bb78-cf3b518446c4 tempest-VolumesActionsTest-246690682 None] Lock "cinder-quobyte-7e077155-ef4c-4cdb-996d-8768f1e4d514" acquired by "delete_volume" :: waited 0.026s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:12 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c8e678-3fd7-434a-8913-69ffeffda9e4]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5460a82d-315b-4efc-bb78-cf3b518446c4 tempest-VolumesActionsTest-246690682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e077155-ef4c-4cdb-996d-8768f1e4d514 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:12 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e077155-ef4c-4cdb-996d-8768f1e4d514 Sep 28 17:12:12 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:12 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2dae7b2e-1a26-4b1e-ad2b-3363462b74d4 1073741824" returned: 0 in 0.736s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2dae7b2e-1a26-4b1e-ad2b-3363462b74d4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:12 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2dae7b2e-1a26-4b1e-ad2b-3363462b74d4 Sep 28 17:12:12 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:12 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5460a82d-315b-4efc-bb78-cf3b518446c4 tempest-VolumesActionsTest-246690682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e077155-ef4c-4cdb-996d-8768f1e4d514" returned: 0 in 0.549s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5460a82d-315b-4efc-bb78-cf3b518446c4 tempest-VolumesActionsTest-246690682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e077155-ef4c-4cdb-996d-8768f1e4d514 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:12 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e077155-ef4c-4cdb-996d-8768f1e4d514 Sep 28 17:12:12 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:12 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2dae7b2e-1a26-4b1e-ad2b-3363462b74d4" returned: 0 in 0.354s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0988b80f-90df-4a4f-939a-79d050103b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dae7b2e-1a26-4b1e-ad2b-3363462b74d4', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (440a6699-f08d-4963-998b-cbd48aed9c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:12 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Volume volume-2dae7b2e-1a26-4b1e-ad2b-3363462b74d4 (2dae7b2e-1a26-4b1e-ad2b-3363462b74d4): created successfully Sep 28 17:12:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (440a6699-f08d-4963-998b-cbd48aed9c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Flow 'volume_create_manager' (3184c5af-ff0c-48f5-9c7d-31c06d3b8161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:12 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-01e71cc3-b6fd-476d-a199-3fd670f82f79 tempest-VolumesTransfersTest-1320399678 None] Created volume successfully. Sep 28 17:12:13 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5460a82d-315b-4efc-bb78-cf3b518446c4 tempest-VolumesActionsTest-246690682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7e077155-ef4c-4cdb-996d-8768f1e4d514" returned: 0 in 0.307s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5460a82d-315b-4efc-bb78-cf3b518446c4 tempest-VolumesActionsTest-246690682 None] Lock "cinder-quobyte-7e077155-ef4c-4cdb-996d-8768f1e4d514" released by "delete_volume" :: held 0.924s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:13 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-5460a82d-315b-4efc-bb78-cf3b518446c4 tempest-VolumesActionsTest-246690682 None] Created reservations ['a8ce1226-e0cc-4b38-81b0-99aae93fc806', '1205fbd9-70aa-4199-afb7-17ab21e1b97b', 'a3470b29-b571-4a2b-a8c0-1695f4f9d2d9', 'b67754de-b5c0-4800-9766-4718e72f90f2'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5460a82d-315b-4efc-bb78-cf3b518446c4 tempest-VolumesActionsTest-246690682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5460a82d-315b-4efc-bb78-cf3b518446c4 tempest-VolumesActionsTest-246690682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:13 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-5460a82d-315b-4efc-bb78-cf3b518446c4 tempest-VolumesActionsTest-246690682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:13 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-5460a82d-315b-4efc-bb78-cf3b518446c4 tempest-VolumesActionsTest-246690682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5460a82d-315b-4efc-bb78-cf3b518446c4 tempest-VolumesActionsTest-246690682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5460a82d-315b-4efc-bb78-cf3b518446c4 tempest-VolumesActionsTest-246690682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:13 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:12:13 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:13 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5460a82d-315b-4efc-bb78-cf3b518446c4 tempest-VolumesActionsTest-246690682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.295s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:13 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-5460a82d-315b-4efc-bb78-cf3b518446c4 tempest-VolumesActionsTest-246690682 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:13 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-5460a82d-315b-4efc-bb78-cf3b518446c4 tempest-VolumesActionsTest-246690682 None] Deleted volume successfully. Sep 28 17:12:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5460a82d-315b-4efc-bb78-cf3b518446c4 tempest-VolumesActionsTest-246690682 None] Lock "cinder-7e077155-ef4c-4cdb-996d-8768f1e4d514-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1d2cb540-b34d-4a01-9a27-8b39b12d726e tempest-VolumesTransfersTest-2121217390 None] Acquiring lock "cinder-2dae7b2e-1a26-4b1e-ad2b-3363462b74d4-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1d2cb540-b34d-4a01-9a27-8b39b12d726e tempest-VolumesTransfersTest-2121217390 None] Lock "cinder-2dae7b2e-1a26-4b1e-ad2b-3363462b74d4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1d2cb540-b34d-4a01-9a27-8b39b12d726e tempest-VolumesTransfersTest-2121217390 None] Acquiring lock "cinder-quobyte-2dae7b2e-1a26-4b1e-ad2b-3363462b74d4" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1d2cb540-b34d-4a01-9a27-8b39b12d726e tempest-VolumesTransfersTest-2121217390 None] Lock "cinder-quobyte-2dae7b2e-1a26-4b1e-ad2b-3363462b74d4" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:14 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7615168-a5c9-4f7e-8f57-d509bf2d2037]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1d2cb540-b34d-4a01-9a27-8b39b12d726e tempest-VolumesTransfersTest-2121217390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2dae7b2e-1a26-4b1e-ad2b-3363462b74d4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:14 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2dae7b2e-1a26-4b1e-ad2b-3363462b74d4 Sep 28 17:12:14 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:14 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1d2cb540-b34d-4a01-9a27-8b39b12d726e tempest-VolumesTransfersTest-2121217390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2dae7b2e-1a26-4b1e-ad2b-3363462b74d4" returned: 0 in 0.516s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1d2cb540-b34d-4a01-9a27-8b39b12d726e tempest-VolumesTransfersTest-2121217390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2dae7b2e-1a26-4b1e-ad2b-3363462b74d4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:14 devstack sudo[96274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2dae7b2e-1a26-4b1e-ad2b-3363462b74d4 Sep 28 17:12:14 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:14 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1d2cb540-b34d-4a01-9a27-8b39b12d726e tempest-VolumesTransfersTest-2121217390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2dae7b2e-1a26-4b1e-ad2b-3363462b74d4" returned: 0 in 0.346s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1d2cb540-b34d-4a01-9a27-8b39b12d726e tempest-VolumesTransfersTest-2121217390 None] Lock "cinder-quobyte-2dae7b2e-1a26-4b1e-ad2b-3363462b74d4" released by "delete_volume" :: held 0.924s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:14 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-1d2cb540-b34d-4a01-9a27-8b39b12d726e tempest-VolumesTransfersTest-2121217390 None] Created reservations ['c0a4ac98-6eeb-4f32-810e-1be01b5beedc', '18314bcc-30fd-45ea-a715-9afe55f333e7', '2c8b59b2-d884-4052-bb00-d521e072960f', 'c23aa471-2c57-4481-be3c-f590e871aec8'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1d2cb540-b34d-4a01-9a27-8b39b12d726e tempest-VolumesTransfersTest-2121217390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1d2cb540-b34d-4a01-9a27-8b39b12d726e tempest-VolumesTransfersTest-2121217390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:15 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1d2cb540-b34d-4a01-9a27-8b39b12d726e tempest-VolumesTransfersTest-2121217390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:15 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1d2cb540-b34d-4a01-9a27-8b39b12d726e tempest-VolumesTransfersTest-2121217390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1d2cb540-b34d-4a01-9a27-8b39b12d726e tempest-VolumesTransfersTest-2121217390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1d2cb540-b34d-4a01-9a27-8b39b12d726e tempest-VolumesTransfersTest-2121217390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:15 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:12:15 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:15 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1d2cb540-b34d-4a01-9a27-8b39b12d726e tempest-VolumesTransfersTest-2121217390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.368s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:15 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1d2cb540-b34d-4a01-9a27-8b39b12d726e tempest-VolumesTransfersTest-2121217390 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:15 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-1d2cb540-b34d-4a01-9a27-8b39b12d726e tempest-VolumesTransfersTest-2121217390 None] Deleted volume successfully. Sep 28 17:12:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1d2cb540-b34d-4a01-9a27-8b39b12d726e tempest-VolumesTransfersTest-2121217390 None] Lock "cinder-2dae7b2e-1a26-4b1e-ad2b-3363462b74d4-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:19 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Flow 'volume_create_manager' (cbf4d690-1e46-4fd4-b8fc-8dd68b818075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0c2f17-c8d0-4b6f-b1b3-a9d12aac097d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0c2f17-c8d0-4b6f-b1b3-a9d12aac097d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1262210828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612af148-e266-4489-b23f-038c49cf8031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d3e5d1c37d4bcb976a048f8056a45b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:20Z,use_quota=True,user_id='1589a00826fa43d8b412325ae9278c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad46777-7295-4df5-aaeb-1488215bcb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad46777-7295-4df5-aaeb-1488215bcb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d7bac4-8f4c-4950-b468-097641559f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d7bac4-8f4c-4950-b468-097641559f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '612af148-e266-4489-b23f-038c49cf8031', 'volume_name': 'volume-612af148-e266-4489-b23f-038c49cf8031', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d54757d-acce-4aa9-8348-a67fe561b680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d54757d-acce-4aa9-8348-a67fe561b680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ddb2535-0548-4078-884a-c77ee6f6771f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:19 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Volume 612af148-e266-4489-b23f-038c49cf8031: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-612af148-e266-4489-b23f-038c49cf8031', 'volume_size': 1} Sep 28 17:12:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1262210828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612af148-e266-4489-b23f-038c49cf8031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d3e5d1c37d4bcb976a048f8056a45b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:20Z,use_quota=True,user_id='1589a00826fa43d8b412325ae9278c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Creating volume 612af148-e266-4489-b23f-038c49cf8031 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:19 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:12:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:19 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031 1073741824 Sep 28 17:12:19 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:20 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031 1073741824" returned: 0 in 0.764s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:20 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031 Sep 28 17:12:20 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:21 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031" returned: 0 in 0.344s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:21 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ddb2535-0548-4078-884a-c77ee6f6771f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-612af148-e266-4489-b23f-038c49cf8031', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (387cc0de-4c72-424a-a41a-bc883a993151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:21 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Volume volume-612af148-e266-4489-b23f-038c49cf8031 (612af148-e266-4489-b23f-038c49cf8031): created successfully Sep 28 17:12:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (387cc0de-4c72-424a-a41a-bc883a993151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Flow 'volume_create_manager' (cbf4d690-1e46-4fd4-b8fc-8dd68b818075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:21 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-60852f2e-ea7e-4ea0-8e30-aa03006e5596 tempest-VolumesCloneTest-965474770 None] Created volume successfully. Sep 28 17:12:22 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Flow 'volume_create_manager' (d640b625-6eb7-4ea9-a80b-c5242e893d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3bee7e1-748c-4799-a9b5-24a183e455f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3bee7e1-748c-4799-a9b5-24a183e455f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-83850883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84e2f3dd-a27b-45cb-8702-cdaafa1e08b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d3e5d1c37d4bcb976a048f8056a45b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=612af148-e266-4489-b23f-038c49cf8031,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:23Z,use_quota=True,user_id='1589a00826fa43d8b412325ae9278c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20bb9da1-0111-4216-b037-d8097261da83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20bb9da1-0111-4216-b037-d8097261da83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73242e5d-2988-4f06-baee-d3009bc71eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73242e5d-2988-4f06-baee-d3009bc71eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '84e2f3dd-a27b-45cb-8702-cdaafa1e08b6', 'volume_name': 'volume-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6', 'volume_size': 2, 'source_volid': '612af148-e266-4489-b23f-038c49cf8031', 'source_volstatus': 'available'}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f70a6c1-64a8-4995-9f8f-b41e0bb69098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f70a6c1-64a8-4995-9f8f-b41e0bb69098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4097b90-ccf2-485a-9bcf-9223f7116b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:22 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Volume 84e2f3dd-a27b-45cb-8702-cdaafa1e08b6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6', 'volume_size': 2, 'source_volid': '612af148-e266-4489-b23f-038c49cf8031', 'source_volstatus': 'available'} Sep 28 17:12:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:22 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Cloning volume 612af148-e266-4489-b23f-038c49cf8031 to volume 84e2f3dd-a27b-45cb-8702-cdaafa1e08b6 Sep 28 17:12:22 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Creating offline snapshot eaf421e0-0aff-4c8e-9142-1204765169d6 of volume 612af148-e266-4489-b23f-038c49cf8031 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:12:22 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a6d2f3-cc1f-4f30-ab92-132470b419eb]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:23 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031 Sep 28 17:12:23 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:23 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031" returned: 0 in 0.538s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:23 devstack sudo[96299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6 1G Sep 28 17:12:23 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:24 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6 1G" returned: 0 in 0.649s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-612af148-e266-4489-b23f-038c49cf8031 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:24 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-612af148-e266-4489-b23f-038c49cf8031 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6 Sep 28 17:12:24 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:24 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-612af148-e266-4489-b23f-038c49cf8031 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6" returned: 0 in 0.459s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:24 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6 is being set with open permissions: ugo+rw Sep 28 17:12:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:24 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6 Sep 28 17:12:24 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:24 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6" returned: 0 in 0.365s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:24 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.info Sep 28 17:12:24 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:25 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.info" returned: 0 in 0.470s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:25 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.info is being set with open permissions: ugo+rw Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:25 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.info Sep 28 17:12:25 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Flow 'volume_create_manager' (19f1a3fb-b904-4479-be3b-3adede742813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69282e48-a324-467c-9d82-f28d4fa2fd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69282e48-a324-467c-9d82-f28d4fa2fd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-332328857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308a7f18-e013-4af0-a5c1-44e03bf56994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbbd4f31b2094f5683d8b0212a5430af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:25Z,use_quota=True,user_id='4fc4c220b4f045f0ae29406ec986f977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19081efc-d275-4bcf-b58c-49c1a2975578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19081efc-d275-4bcf-b58c-49c1a2975578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6555185d-7193-49b4-a96a-38f1e7299215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6555185d-7193-49b4-a96a-38f1e7299215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '308a7f18-e013-4af0-a5c1-44e03bf56994', 'volume_name': 'volume-308a7f18-e013-4af0-a5c1-44e03bf56994', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd63ee3d-b466-4927-a7c9-ee12ab7cad98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd63ee3d-b466-4927-a7c9-ee12ab7cad98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f759f9-ae1c-4267-8c54-4d00a71dc67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:25 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Volume 308a7f18-e013-4af0-a5c1-44e03bf56994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-308a7f18-e013-4af0-a5c1-44e03bf56994', 'volume_size': 1} Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:25 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.info" returned: 0 in 0.324s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Acquiring lock "cinder-quobyte-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6" by "_copy_volume_from_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Lock "cinder-quobyte-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] snapshot: eaf421e0-0aff-4c8e-9142-1204765169d6, volume: 84e2f3dd-a27b-45cb-8702-cdaafa1e08b6, {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f047e6-b61c-468b-a87f-e83a30fc34ca]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:25 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6 Sep 28 17:12:25 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:26 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6" returned: 0 in 0.396s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-612af148-e266-4489-b23f-038c49cf8031(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:26 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[3181f734-dc61-4581-8aca-9ba659670bfe]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:26 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031 Sep 28 17:12:26 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:26 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031" returned: 0 in 0.529s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031 {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:12:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Creating direct copy from snapshot {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:12:26 devstack cinder-volume[87061]: DEBUG cinder.utils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Path /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6 not found in is_blk_device check {{(pid=87061) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:12:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:26 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6 Sep 28 17:12:26 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:32 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:UPDATE=153,cinder:SELECT=107,cinder:DELETE=11,cinder:INSERT=32 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:12:32 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=111,cinder:INSERT=34,cinder:UPDATE=136,cinder:DELETE=15 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:12:32 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-390571c3-3de2-4af9-bafd-fcd91b553e96 req-c74a9dea-8666-4ec0-a29a-3d0ad40207c5 tempest-AttachVolumeTestJSON-1078994482 None] Terminate volume connection completed successfully. Sep 28 17:12:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-390571c3-3de2-4af9-bafd-fcd91b553e96 req-c74a9dea-8666-4ec0-a29a-3d0ad40207c5 tempest-AttachVolumeTestJSON-1078994482 None] Deleting attachment f2ee56a5-df11-4112-9b8f-c188bf6e2b07. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:12:34 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6" returned: 0 in 7.687s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:34 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Image conversion details: src /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031, size 1024.00 MB, duration 7.69 sec, destination /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6 {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:12:34 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Converted 1024.00 MB image at 133.18 MB/s Sep 28 17:12:34 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6 is being set with open permissions: ugo+rw Sep 28 17:12:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:34 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6 Sep 28 17:12:34 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:34 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6" returned: 0 in 0.308s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:34 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Lock "cinder-quobyte-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6" released by "_copy_volume_from_snapshot" :: held 9.009s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:34 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Acquiring lock "cinder-quobyte-eaf421e0-0aff-4c8e-9142-1204765169d6" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:34 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Lock "cinder-quobyte-eaf421e0-0aff-4c8e-9142-1204765169d6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Deleting offline snapshot eaf421e0-0aff-4c8e-9142-1204765169d6 of volume 612af148-e266-4489-b23f-038c49cf8031 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:12:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] snapshot_file for this snap is: volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:12:34 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[112d9a5c-3cb4-4b40-956a-425ecdd56eb8]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:35 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6 Sep 28 17:12:35 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:35 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6" returned: 0 in 0.445s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-612af148-e266-4489-b23f-038c49cf8031(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:35 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5cccb9-b8c1-4162-be48-12ee83b1fd8f]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:35 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031 Sep 28 17:12:35 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:36 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031" returned: 0 in 0.793s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:36 devstack sudo[96377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6 Sep 28 17:12:36 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:36 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Flow 'volume_create_manager' (646513ea-ad93-4a1f-867a-25a73dc40004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e891236d-802e-4299-9455-08c33d1dd811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e891236d-802e-4299-9455-08c33d1dd811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-37676607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f883000-95fd-4fa3-b3c1-85e06a24eb10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c9fbd2e3544fc4910b724737c31fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:36Z,use_quota=True,user_id='6aaa93421678432db6c6a60f1bacd002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3647eb46-d7e6-46f5-b006-015d6db9edff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3647eb46-d7e6-46f5-b006-015d6db9edff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd105f3-e7a4-48e1-b91d-af244d3b3ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd105f3-e7a4-48e1-b91d-af244d3b3ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f883000-95fd-4fa3-b3c1-85e06a24eb10', 'volume_name': 'volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6430266e-ca13-416a-ae7f-68b795d83738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6430266e-ca13-416a-ae7f-68b795d83738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62473b9-59a3-46e9-bfed-266085c9fb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:36 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Volume 3f883000-95fd-4fa3-b3c1-85e06a24eb10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10', 'volume_size': 1} Sep 28 17:12:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:36 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6" returned: 0 in 0.490s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:36 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6 Sep 28 17:12:36 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:36 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031.eaf421e0-0aff-4c8e-9142-1204765169d6" returned: 0 in 0.307s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Lock "cinder-quobyte-eaf421e0-0aff-4c8e-9142-1204765169d6" released by "_delete_snapshot" :: held 2.183s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.285s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.434s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-332328857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308a7f18-e013-4af0-a5c1-44e03bf56994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbbd4f31b2094f5683d8b0212a5430af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:25Z,use_quota=True,user_id='4fc4c220b4f045f0ae29406ec986f977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Creating volume 308a7f18-e013-4af0-a5c1-44e03bf56994 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:37 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:12:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-308a7f18-e013-4af0-a5c1-44e03bf56994 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4097b90-ccf2-485a-9bcf-9223f7116b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6', 'volume_size': 2, 'source_volid': '612af148-e266-4489-b23f-038c49cf8031', 'source_volstatus': 'available'}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dede7a5-53e3-4f83-9abd-5bdc4dec0fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:37 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-308a7f18-e013-4af0-a5c1-44e03bf56994 1073741824 Sep 28 17:12:37 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:37 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Volume volume-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6 (84e2f3dd-a27b-45cb-8702-cdaafa1e08b6): created successfully Sep 28 17:12:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dede7a5-53e3-4f83-9abd-5bdc4dec0fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Flow 'volume_create_manager' (d640b625-6eb7-4ea9-a80b-c5242e893d2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:37 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-78a97f96-bbfd-442f-8235-1e16f0e63477 tempest-VolumesCloneTest-965474770 None] Created volume successfully. Sep 28 17:12:37 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-308a7f18-e013-4af0-a5c1-44e03bf56994 1073741824" returned: 0 in 0.890s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-308a7f18-e013-4af0-a5c1-44e03bf56994 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:38 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-308a7f18-e013-4af0-a5c1-44e03bf56994 Sep 28 17:12:38 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:38 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-308a7f18-e013-4af0-a5c1-44e03bf56994" returned: 0 in 0.502s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.148s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-37676607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f883000-95fd-4fa3-b3c1-85e06a24eb10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c9fbd2e3544fc4910b724737c31fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:36Z,use_quota=True,user_id='6aaa93421678432db6c6a60f1bacd002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Creating volume 3f883000-95fd-4fa3-b3c1-85e06a24eb10 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:38 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:12:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:38 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10 1073741824 Sep 28 17:12:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f759f9-ae1c-4267-8c54-4d00a71dc67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-308a7f18-e013-4af0-a5c1-44e03bf56994', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7488c75b-10de-4d07-94de-b5209424416c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:38 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:38 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Volume volume-308a7f18-e013-4af0-a5c1-44e03bf56994 (308a7f18-e013-4af0-a5c1-44e03bf56994): created successfully Sep 28 17:12:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7488c75b-10de-4d07-94de-b5209424416c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Flow 'volume_create_manager' (19f1a3fb-b904-4479-be3b-3adede742813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:38 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-494a04f5-56ac-4f4c-b5b9-48bc64f25b6c tempest-VolumesNegativeTest-8885296 None] Created volume successfully. Sep 28 17:12:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-df5829ce-51cd-463d-8ac7-dc24889b2050 tempest-VolumesCloneTest-965474770 None] Acquiring lock "cinder-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-df5829ce-51cd-463d-8ac7-dc24889b2050 tempest-VolumesCloneTest-965474770 None] Lock "cinder-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-df5829ce-51cd-463d-8ac7-dc24889b2050 tempest-VolumesCloneTest-965474770 None] Acquiring lock "cinder-quobyte-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-df5829ce-51cd-463d-8ac7-dc24889b2050 tempest-VolumesCloneTest-965474770 None] Lock "cinder-quobyte-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6" acquired by "delete_volume" :: waited 0.051s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:39 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7aef12-25c9-40bb-8a7b-d1c875d2321f]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df5829ce-51cd-463d-8ac7-dc24889b2050 tempest-VolumesCloneTest-965474770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:39 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6 Sep 28 17:12:39 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:39 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10 1073741824" returned: 0 in 1.160s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:39 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10 Sep 28 17:12:39 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:40 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df5829ce-51cd-463d-8ac7-dc24889b2050 tempest-VolumesCloneTest-965474770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6" returned: 0 in 1.006s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df5829ce-51cd-463d-8ac7-dc24889b2050 tempest-VolumesCloneTest-965474770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:40 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6 Sep 28 17:12:40 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:40 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10" returned: 0 in 0.548s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:40 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62473b9-59a3-46e9-bfed-266085c9fb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a460f7e-cceb-4a9c-9faa-ea85d8cbeb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:40 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Volume volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10 (3f883000-95fd-4fa3-b3c1-85e06a24eb10): created successfully Sep 28 17:12:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a460f7e-cceb-4a9c-9faa-ea85d8cbeb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Flow 'volume_create_manager' (646513ea-ad93-4a1f-867a-25a73dc40004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:40 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-ffed588f-4165-43f7-81a8-d98922bac0d4 tempest-SnapshotMetadataTestJSON-288109505 None] Created volume successfully. Sep 28 17:12:40 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df5829ce-51cd-463d-8ac7-dc24889b2050 tempest-VolumesCloneTest-965474770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6" returned: 0 in 0.458s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-df5829ce-51cd-463d-8ac7-dc24889b2050 tempest-VolumesCloneTest-965474770 None] Lock "cinder-quobyte-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6" released by "delete_volume" :: held 1.579s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:40 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-df5829ce-51cd-463d-8ac7-dc24889b2050 tempest-VolumesCloneTest-965474770 None] Created reservations ['aa765783-e68d-4527-974e-b6b1726ce3ff', '42732004-69f6-4d64-8ff6-d5221f141c1c', 'c6d7c73c-0021-4ec6-90a3-3b2aa979b57b', '1d78fa26-8187-4bc8-8314-e24ac78f85c2'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-df5829ce-51cd-463d-8ac7-dc24889b2050 tempest-VolumesCloneTest-965474770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-df5829ce-51cd-463d-8ac7-dc24889b2050 tempest-VolumesCloneTest-965474770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:40 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-df5829ce-51cd-463d-8ac7-dc24889b2050 tempest-VolumesCloneTest-965474770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-df5829ce-51cd-463d-8ac7-dc24889b2050 tempest-VolumesCloneTest-965474770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-df5829ce-51cd-463d-8ac7-dc24889b2050 tempest-VolumesCloneTest-965474770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df5829ce-51cd-463d-8ac7-dc24889b2050 tempest-VolumesCloneTest-965474770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:41 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:12:41 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-bc437601-9b07-44f8-a20a-22c16d751836 tempest-SnapshotMetadataTestJSON-288109505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-bc437601-9b07-44f8-a20a-22c16d751836 tempest-SnapshotMetadataTestJSON-288109505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-bc437601-9b07-44f8-a20a-22c16d751836 tempest-SnapshotMetadataTestJSON-288109505 None] Creating offline snapshot ba7a30a2-c1be-46ad-bd55-6e0e44f1b593 of volume 3f883000-95fd-4fa3-b3c1-85e06a24eb10 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:12:41 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8c4f93-ac60-47bd-9e22-a3a5c35f2901]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bc437601-9b07-44f8-a20a-22c16d751836 tempest-SnapshotMetadataTestJSON-288109505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:41 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df5829ce-51cd-463d-8ac7-dc24889b2050 tempest-VolumesCloneTest-965474770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.398s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:41 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10 Sep 28 17:12:41 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:41 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-df5829ce-51cd-463d-8ac7-dc24889b2050 tempest-VolumesCloneTest-965474770 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:41 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-df5829ce-51cd-463d-8ac7-dc24889b2050 tempest-VolumesCloneTest-965474770 None] Deleted volume successfully. Sep 28 17:12:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-df5829ce-51cd-463d-8ac7-dc24889b2050 tempest-VolumesCloneTest-965474770 None] Lock "cinder-84e2f3dd-a27b-45cb-8702-cdaafa1e08b6-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-62861012-9a24-4f19-9172-140c5486b10b tempest-VolumesCloneTest-965474770 None] Acquiring lock "cinder-612af148-e266-4489-b23f-038c49cf8031-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-62861012-9a24-4f19-9172-140c5486b10b tempest-VolumesCloneTest-965474770 None] Lock "cinder-612af148-e266-4489-b23f-038c49cf8031-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-62861012-9a24-4f19-9172-140c5486b10b tempest-VolumesCloneTest-965474770 None] Acquiring lock "cinder-quobyte-612af148-e266-4489-b23f-038c49cf8031" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-62861012-9a24-4f19-9172-140c5486b10b tempest-VolumesCloneTest-965474770 None] Lock "cinder-quobyte-612af148-e266-4489-b23f-038c49cf8031" acquired by "delete_volume" :: waited 0.027s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:41 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1acb4f7-5006-4a03-bdc7-b016eb7de1e9]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62861012-9a24-4f19-9172-140c5486b10b tempest-VolumesCloneTest-965474770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:41 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bc437601-9b07-44f8-a20a-22c16d751836 tempest-SnapshotMetadataTestJSON-288109505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10" returned: 0 in 0.796s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bc437601-9b07-44f8-a20a-22c16d751836 tempest-SnapshotMetadataTestJSON-288109505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.ba7a30a2-c1be-46ad-bd55-6e0e44f1b593 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:42 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.ba7a30a2-c1be-46ad-bd55-6e0e44f1b593 1G Sep 28 17:12:42 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:42 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031 Sep 28 17:12:42 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:42 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62861012-9a24-4f19-9172-140c5486b10b tempest-VolumesCloneTest-965474770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031" returned: 0 in 0.916s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62861012-9a24-4f19-9172-140c5486b10b tempest-VolumesCloneTest-965474770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:42 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031 Sep 28 17:12:42 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:43 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bc437601-9b07-44f8-a20a-22c16d751836 tempest-SnapshotMetadataTestJSON-288109505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.ba7a30a2-c1be-46ad-bd55-6e0e44f1b593 1G" returned: 0 in 1.055s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bc437601-9b07-44f8-a20a-22c16d751836 tempest-SnapshotMetadataTestJSON-288109505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.ba7a30a2-c1be-46ad-bd55-6e0e44f1b593 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:43 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.ba7a30a2-c1be-46ad-bd55-6e0e44f1b593 Sep 28 17:12:43 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:43 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62861012-9a24-4f19-9172-140c5486b10b tempest-VolumesCloneTest-965474770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-612af148-e266-4489-b23f-038c49cf8031" returned: 0 in 0.464s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-62861012-9a24-4f19-9172-140c5486b10b tempest-VolumesCloneTest-965474770 None] Lock "cinder-quobyte-612af148-e266-4489-b23f-038c49cf8031" released by "delete_volume" :: held 1.504s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:43 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-62861012-9a24-4f19-9172-140c5486b10b tempest-VolumesCloneTest-965474770 None] Created reservations ['ad3ce43c-df2c-4f6b-a9eb-9ee5cb84f8e2', '6568b531-2be7-4b63-aa09-da57cd6012d2', '6dbe51c4-bbfe-4382-b0fb-8d1855a5e327', '80168d64-27bc-46ed-9d5a-d9577a5ef708'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-62861012-9a24-4f19-9172-140c5486b10b tempest-VolumesCloneTest-965474770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-62861012-9a24-4f19-9172-140c5486b10b tempest-VolumesCloneTest-965474770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:43 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-62861012-9a24-4f19-9172-140c5486b10b tempest-VolumesCloneTest-965474770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:43 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-62861012-9a24-4f19-9172-140c5486b10b tempest-VolumesCloneTest-965474770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-62861012-9a24-4f19-9172-140c5486b10b tempest-VolumesCloneTest-965474770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62861012-9a24-4f19-9172-140c5486b10b tempest-VolumesCloneTest-965474770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:43 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:12:43 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:43 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bc437601-9b07-44f8-a20a-22c16d751836 tempest-SnapshotMetadataTestJSON-288109505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.ba7a30a2-c1be-46ad-bd55-6e0e44f1b593" returned: 0 in 0.719s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:43 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-bc437601-9b07-44f8-a20a-22c16d751836 tempest-SnapshotMetadataTestJSON-288109505 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.ba7a30a2-c1be-46ad-bd55-6e0e44f1b593 is being set with open permissions: ugo+rw Sep 28 17:12:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bc437601-9b07-44f8-a20a-22c16d751836 tempest-SnapshotMetadataTestJSON-288109505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.ba7a30a2-c1be-46ad-bd55-6e0e44f1b593 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:43 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.ba7a30a2-c1be-46ad-bd55-6e0e44f1b593 Sep 28 17:12:43 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:44 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62861012-9a24-4f19-9172-140c5486b10b tempest-VolumesCloneTest-965474770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.479s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:44 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-62861012-9a24-4f19-9172-140c5486b10b tempest-VolumesCloneTest-965474770 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:44 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-62861012-9a24-4f19-9172-140c5486b10b tempest-VolumesCloneTest-965474770 None] Deleted volume successfully. Sep 28 17:12:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-62861012-9a24-4f19-9172-140c5486b10b tempest-VolumesCloneTest-965474770 None] Lock "cinder-612af148-e266-4489-b23f-038c49cf8031-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:44 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bc437601-9b07-44f8-a20a-22c16d751836 tempest-SnapshotMetadataTestJSON-288109505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.ba7a30a2-c1be-46ad-bd55-6e0e44f1b593" returned: 0 in 0.546s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bc437601-9b07-44f8-a20a-22c16d751836 tempest-SnapshotMetadataTestJSON-288109505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:44 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.info Sep 28 17:12:44 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:44 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bc437601-9b07-44f8-a20a-22c16d751836 tempest-SnapshotMetadataTestJSON-288109505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.info" returned: 0 in 0.512s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:44 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-bc437601-9b07-44f8-a20a-22c16d751836 tempest-SnapshotMetadataTestJSON-288109505 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.info is being set with open permissions: ugo+rw Sep 28 17:12:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bc437601-9b07-44f8-a20a-22c16d751836 tempest-SnapshotMetadataTestJSON-288109505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:44 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.info Sep 28 17:12:44 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:45 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bc437601-9b07-44f8-a20a-22c16d751836 tempest-SnapshotMetadataTestJSON-288109505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.info" returned: 0 in 0.638s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-bc437601-9b07-44f8-a20a-22c16d751836 tempest-SnapshotMetadataTestJSON-288109505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.465s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:45 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-bc437601-9b07-44f8-a20a-22c16d751836 tempest-SnapshotMetadataTestJSON-288109505 None] Create snapshot completed successfully Sep 28 17:12:48 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3291f7bd-c090-40ea-aa1d-a31c87d8fdd9 tempest-SnapshotMetadataTestJSON-288109505 None] Acquiring lock "cinder-ba7a30a2-c1be-46ad-bd55-6e0e44f1b593-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:48 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3291f7bd-c090-40ea-aa1d-a31c87d8fdd9 tempest-SnapshotMetadataTestJSON-288109505 None] Lock "cinder-ba7a30a2-c1be-46ad-bd55-6e0e44f1b593-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:48 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3291f7bd-c090-40ea-aa1d-a31c87d8fdd9 tempest-SnapshotMetadataTestJSON-288109505 None] Acquiring lock "cinder-quobyte-3f883000-95fd-4fa3-b3c1-85e06a24eb10" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:48 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3291f7bd-c090-40ea-aa1d-a31c87d8fdd9 tempest-SnapshotMetadataTestJSON-288109505 None] Lock "cinder-quobyte-3f883000-95fd-4fa3-b3c1-85e06a24eb10" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:48 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3291f7bd-c090-40ea-aa1d-a31c87d8fdd9 tempest-SnapshotMetadataTestJSON-288109505 None] Acquiring lock "cinder-quobyte-ba7a30a2-c1be-46ad-bd55-6e0e44f1b593" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:48 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3291f7bd-c090-40ea-aa1d-a31c87d8fdd9 tempest-SnapshotMetadataTestJSON-288109505 None] Lock "cinder-quobyte-ba7a30a2-c1be-46ad-bd55-6e0e44f1b593" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:48 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-3291f7bd-c090-40ea-aa1d-a31c87d8fdd9 tempest-SnapshotMetadataTestJSON-288109505 None] Deleting offline snapshot ba7a30a2-c1be-46ad-bd55-6e0e44f1b593 of volume 3f883000-95fd-4fa3-b3c1-85e06a24eb10 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:12:48 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-3291f7bd-c090-40ea-aa1d-a31c87d8fdd9 tempest-SnapshotMetadataTestJSON-288109505 None] snapshot_file for this snap is: volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.ba7a30a2-c1be-46ad-bd55-6e0e44f1b593 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:12:48 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[67666246-0c80-4716-8a9e-884a2953cf60]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3291f7bd-c090-40ea-aa1d-a31c87d8fdd9 tempest-SnapshotMetadataTestJSON-288109505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.ba7a30a2-c1be-46ad-bd55-6e0e44f1b593 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:48 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.ba7a30a2-c1be-46ad-bd55-6e0e44f1b593 Sep 28 17:12:48 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:49 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3291f7bd-c090-40ea-aa1d-a31c87d8fdd9 tempest-SnapshotMetadataTestJSON-288109505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.ba7a30a2-c1be-46ad-bd55-6e0e44f1b593" returned: 0 in 0.555s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:49 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-3291f7bd-c090-40ea-aa1d-a31c87d8fdd9 tempest-SnapshotMetadataTestJSON-288109505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:49 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a37a10d-525d-47a5-bc0b-0639f9773b81]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3291f7bd-c090-40ea-aa1d-a31c87d8fdd9 tempest-SnapshotMetadataTestJSON-288109505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:49 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10 Sep 28 17:12:49 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:49 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3291f7bd-c090-40ea-aa1d-a31c87d8fdd9 tempest-SnapshotMetadataTestJSON-288109505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10" returned: 0 in 0.601s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3291f7bd-c090-40ea-aa1d-a31c87d8fdd9 tempest-SnapshotMetadataTestJSON-288109505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.ba7a30a2-c1be-46ad-bd55-6e0e44f1b593 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:49 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.ba7a30a2-c1be-46ad-bd55-6e0e44f1b593 Sep 28 17:12:49 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:50 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3291f7bd-c090-40ea-aa1d-a31c87d8fdd9 tempest-SnapshotMetadataTestJSON-288109505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.ba7a30a2-c1be-46ad-bd55-6e0e44f1b593" returned: 0 in 0.598s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3291f7bd-c090-40ea-aa1d-a31c87d8fdd9 tempest-SnapshotMetadataTestJSON-288109505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.ba7a30a2-c1be-46ad-bd55-6e0e44f1b593 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:50 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.ba7a30a2-c1be-46ad-bd55-6e0e44f1b593 Sep 28 17:12:50 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:50 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3291f7bd-c090-40ea-aa1d-a31c87d8fdd9 tempest-SnapshotMetadataTestJSON-288109505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10.ba7a30a2-c1be-46ad-bd55-6e0e44f1b593" returned: 0 in 0.448s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:50 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3291f7bd-c090-40ea-aa1d-a31c87d8fdd9 tempest-SnapshotMetadataTestJSON-288109505 None] Lock "cinder-quobyte-ba7a30a2-c1be-46ad-bd55-6e0e44f1b593" released by "_delete_snapshot" :: held 2.428s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:50 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3291f7bd-c090-40ea-aa1d-a31c87d8fdd9 tempest-SnapshotMetadataTestJSON-288109505 None] Lock "cinder-quobyte-3f883000-95fd-4fa3-b3c1-85e06a24eb10" released by "delete_snapshot" :: held 2.478s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:51 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-3291f7bd-c090-40ea-aa1d-a31c87d8fdd9 tempest-SnapshotMetadataTestJSON-288109505 None] Created reservations ['5e6af4fc-c4e0-4c9a-9b0b-3e666f82e5f9', '56e4323b-4c45-4f22-bc58-be0426e88f56', '04cc5f60-9c48-44c1-8406-adc79c612081', 'b45dbd11-eeb5-4b9d-8bb4-699be1d2624e'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:51 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-3291f7bd-c090-40ea-aa1d-a31c87d8fdd9 tempest-SnapshotMetadataTestJSON-288109505 None] Delete snapshot completed successfully. Sep 28 17:12:51 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3291f7bd-c090-40ea-aa1d-a31c87d8fdd9 tempest-SnapshotMetadataTestJSON-288109505 None] Lock "cinder-ba7a30a2-c1be-46ad-bd55-6e0e44f1b593-delete_snapshot" released by "delete_snapshot" :: held 2.967s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:52 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4ff5ceb1-21f4-465e-bca8-158ce90803f6 tempest-SnapshotMetadataTestJSON-288109505 None] Acquiring lock "cinder-3f883000-95fd-4fa3-b3c1-85e06a24eb10-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:52 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4ff5ceb1-21f4-465e-bca8-158ce90803f6 tempest-SnapshotMetadataTestJSON-288109505 None] Lock "cinder-3f883000-95fd-4fa3-b3c1-85e06a24eb10-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:52 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4ff5ceb1-21f4-465e-bca8-158ce90803f6 tempest-SnapshotMetadataTestJSON-288109505 None] Acquiring lock "cinder-quobyte-3f883000-95fd-4fa3-b3c1-85e06a24eb10" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:52 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4ff5ceb1-21f4-465e-bca8-158ce90803f6 tempest-SnapshotMetadataTestJSON-288109505 None] Lock "cinder-quobyte-3f883000-95fd-4fa3-b3c1-85e06a24eb10" acquired by "delete_volume" :: waited 0.062s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:52 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[51633710-f9b1-4dec-a6fb-dbb00402db17]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4ff5ceb1-21f4-465e-bca8-158ce90803f6 tempest-SnapshotMetadataTestJSON-288109505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:53 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Flow 'volume_create_manager' (08ef19ca-22a7-4f3b-a5b6-4db6081f9421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f437688-854b-4924-8004-8c147d2337c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f437688-854b-4924-8004-8c147d2337c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1210701328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a3500c-f6c2-45d6-9f15-893605732eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39ae361834249fd8b3d279ca4be971e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:53Z,use_quota=True,user_id='eb55034e91284fa69af2ff4a9f330c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94246b66-192f-4801-86a3-da63aa804dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94246b66-192f-4801-86a3-da63aa804dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a2a9eb9-5e9f-4656-a64e-cf9797cdbf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:53 devstack cinder-volume[87061]: DEBUG cinder.image.glance [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Creating Keystone auth plugin from conf {{(pid=87061) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:12:53 devstack sudo[96679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10 Sep 28 17:12:53 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a2a9eb9-5e9f-4656-a64e-cf9797cdbf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '01a3500c-f6c2-45d6-9f15-893605732eee', 'volume_name': 'volume-01a3500c-f6c2-45d6-9f15-893605732eee', 'volume_size': 1, 'image_id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21d27c6a4ac749c0a5b3cbd558b3b102', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'created_at': datetime.datetime(2026, 9, 28, 14, 57, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3da6edc3-4055-4154-be43-a897ff97d7cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b778eca1-89a4-4b5d-9b8d-7e469e2fce85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b778eca1-89a4-4b5d-9b8d-7e469e2fce85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ff7d46-c825-4b04-aabe-b8095f95c15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:53 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Volume 01a3500c-f6c2-45d6-9f15-893605732eee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-01a3500c-f6c2-45d6-9f15-893605732eee', 'volume_size': 1, 'image_id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21d27c6a4ac749c0a5b3cbd558b3b102', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'created_at': datetime.datetime(2026, 9, 28, 14, 57, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3da6edc3-4055-4154-be43-a897ff97d7cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:12:53 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Trying to clone 01a3500c-f6c2-45d6-9f15-893605732eee from image 3da6edc3-4055-4154-be43-a897ff97d7cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}]). {{(pid=87061) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:12:53 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4ff5ceb1-21f4-465e-bca8-158ce90803f6 tempest-SnapshotMetadataTestJSON-288109505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10" returned: 0 in 1.052s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4ff5ceb1-21f4-465e-bca8-158ce90803f6 tempest-SnapshotMetadataTestJSON-288109505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:53 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10 Sep 28 17:12:54 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:54 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_p06kudimdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:12:54 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:12:54 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8ee4e4-615a-44ee-950f-8689087e7279]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_p06kudimdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:54 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4ff5ceb1-21f4-465e-bca8-158ce90803f6 tempest-SnapshotMetadataTestJSON-288109505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f883000-95fd-4fa3-b3c1-85e06a24eb10" returned: 0 in 0.625s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:54 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4ff5ceb1-21f4-465e-bca8-158ce90803f6 tempest-SnapshotMetadataTestJSON-288109505 None] Lock "cinder-quobyte-3f883000-95fd-4fa3-b3c1-85e06a24eb10" released by "delete_volume" :: held 1.906s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:54 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_p06kudimdevstack@QuobyteHD Sep 28 17:12:54 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:54 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-4ff5ceb1-21f4-465e-bca8-158ce90803f6 tempest-SnapshotMetadataTestJSON-288109505 None] Created reservations ['de18ff2a-f22a-4ddc-ab69-97e1b1f2c337', '73a39b42-6370-42d1-96d8-e5060b44f767', '5b78feed-b69a-499d-891f-156d2a9c549e', 'ee5f897f-ba7b-4f26-ba60-22579b795738'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4ff5ceb1-21f4-465e-bca8-158ce90803f6 tempest-SnapshotMetadataTestJSON-288109505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4ff5ceb1-21f4-465e-bca8-158ce90803f6 tempest-SnapshotMetadataTestJSON-288109505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:54 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4ff5ceb1-21f4-465e-bca8-158ce90803f6 tempest-SnapshotMetadataTestJSON-288109505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:54 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4ff5ceb1-21f4-465e-bca8-158ce90803f6 tempest-SnapshotMetadataTestJSON-288109505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4ff5ceb1-21f4-465e-bca8-158ce90803f6 tempest-SnapshotMetadataTestJSON-288109505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4ff5ceb1-21f4-465e-bca8-158ce90803f6 tempest-SnapshotMetadataTestJSON-288109505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:54 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:12:54 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:55 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:55 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_p06kudimdevstack@QuobyteHD" returned: 0 in 0.812s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:55 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Temporary image 3da6edc3-4055-4154-be43-a897ff97d7cf is fetched for user eb55034e91284fa69af2ff4a9f330c37. {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:12:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4ff5ceb1-21f4-465e-bca8-158ce90803f6 tempest-SnapshotMetadataTestJSON-288109505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.472s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:55 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-4ff5ceb1-21f4-465e-bca8-158ce90803f6 tempest-SnapshotMetadataTestJSON-288109505 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:55 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-4ff5ceb1-21f4-465e-bca8-158ce90803f6 tempest-SnapshotMetadataTestJSON-288109505 None] Deleted volume successfully. Sep 28 17:12:55 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4ff5ceb1-21f4-465e-bca8-158ce90803f6 tempest-SnapshotMetadataTestJSON-288109505 None] Lock "cinder-3f883000-95fd-4fa3-b3c1-85e06a24eb10-delete_volume" released by "delete_volume" :: held 3.041s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:55 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[38df4d1f-cb9c-4ba2-8f74-a00216bca3f2]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_p06kudimdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:55 devstack sudo[96723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_p06kudimdevstack@QuobyteHD Sep 28 17:12:55 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:56 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_p06kudimdevstack@QuobyteHD" returned: 0 in 0.733s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:56 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1210701328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a3500c-f6c2-45d6-9f15-893605732eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39ae361834249fd8b3d279ca4be971e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:53Z,use_quota=True,user_id='eb55034e91284fa69af2ff4a9f330c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:56 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Creating volume 01a3500c-f6c2-45d6-9f15-893605732eee {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:56 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:56 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:56 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:56 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:12:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:56 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee 1073741824 Sep 28 17:12:56 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:57 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee 1073741824" returned: 0 in 0.880s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:57 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee Sep 28 17:12:57 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:57 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee" returned: 0 in 0.617s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:58 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Attempting download of 3da6edc3-4055-4154-be43-a897ff97d7cf ((None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}])) to volume 01a3500c-f6c2-45d6-9f15-893605732eee. {{(pid=87061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:12:58 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[585f3c37-c69c-4f4b-8c34-d48509bb082d]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_7wwe6yys {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:58 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_7wwe6yys Sep 28 17:12:58 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:58 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_7wwe6yys" returned: 0 in 0.498s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_7wwe6yys {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:59 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_7wwe6yys Sep 28 17:12:59 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:59 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_7wwe6yys" returned: 1 in 0.628s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_7wwe6yys' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:12:59 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[6674d2e4-e8a9-4054-becc-bb57d1fd451d]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_p06kudimdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:59 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_p06kudimdevstack@QuobyteHD Sep 28 17:12:59 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:59 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_p06kudimdevstack@QuobyteHD" returned: 0 in 0.455s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:59 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] 3da6edc3-4055-4154-be43-a897ff97d7cf was qcow2, converting to qcow2 {{(pid=87061) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:12:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_p06kudimdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:59 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_p06kudimdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee Sep 28 17:12:59 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Flow 'volume_create_manager' (3b04ff59-9af5-485b-86fb-45c2d04a3246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef2e1b9-5bf4-49f6-9afc-82358c21be9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef2e1b9-5bf4-49f6-9afc-82358c21be9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1004664189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a6bc3b76cc480fb53336bca07a6c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:03Z,use_quota=True,user_id='00063c06d744487cac069ec244c649aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca4b163-f655-4ad0-b15a-e189c9bb2971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca4b163-f655-4ad0-b15a-e189c9bb2971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a8c78a-1466-48e4-83ca-3869c1e74f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a8c78a-1466-48e4-83ca-3869c1e74f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2', 'volume_name': 'volume-a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2', 'volume_size': 2}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75f01af8-6a02-404f-bf79-c99a6772978f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75f01af8-6a02-404f-bf79-c99a6772978f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00ce9c5-0887-4176-8c4d-d0be601d0a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:02 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Volume a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2', 'volume_size': 2} Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1004664189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a6bc3b76cc480fb53336bca07a6c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:03Z,use_quota=True,user_id='00063c06d744487cac069ec244c649aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Creating volume a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:02 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2 2147483648 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:02 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2 2147483648 Sep 28 17:13:02 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:02 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_p06kudimdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee" returned: 0 in 2.857s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_p06kudimdevstack@QuobyteHD, size 112.00 MB, duration 2.86 sec, destination /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:13:02 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Converted 112.00 MB image at 39.19 MB/s Sep 28 17:13:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:02 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee 1G Sep 28 17:13:02 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:03 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee 1G" returned: 0 in 0.413s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:03 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Downloaded image 3da6edc3-4055-4154-be43-a897ff97d7cf ((None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}])) to volume 01a3500c-f6c2-45d6-9f15-893605732eee successfully. {{(pid=87061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:13:03 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Temporary image 3da6edc3-4055-4154-be43-a897ff97d7cf for user eb55034e91284fa69af2ff4a9f330c37 is deleted. {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:13:03 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Marking volume 01a3500c-f6c2-45d6-9f15-893605732eee as bootable. {{(pid=87061) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:13:03 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Copying metadata from image 3da6edc3-4055-4154-be43-a897ff97d7cf to 01a3500c-f6c2-45d6-9f15-893605732eee. {{(pid=87061) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:13:03 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Creating volume glance metadata for volume 01a3500c-f6c2-45d6-9f15-893605732eee backed by image 3da6edc3-4055-4154-be43-a897ff97d7cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87061) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:13:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ff7d46-c825-4b04-aabe-b8095f95c15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01a3500c-f6c2-45d6-9f15-893605732eee', 'volume_size': 1, 'image_id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21d27c6a4ac749c0a5b3cbd558b3b102', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'created_at': datetime.datetime(2026, 9, 28, 14, 57, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3da6edc3-4055-4154-be43-a897ff97d7cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c14318f4-6572-4022-b162-a52f0a89bee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:03 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Volume volume-01a3500c-f6c2-45d6-9f15-893605732eee (01a3500c-f6c2-45d6-9f15-893605732eee): created successfully Sep 28 17:13:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c14318f4-6572-4022-b162-a52f0a89bee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Flow 'volume_create_manager' (08ef19ca-22a7-4f3b-a5b6-4db6081f9421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:03 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2 2147483648" returned: 0 in 0.712s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:03 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-ed7bee83-4059-4ad3-96d7-1d87f053feed tempest-VolumesExtendTest-1623065699 None] Created volume successfully. Sep 28 17:13:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:03 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2 Sep 28 17:13:03 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:03 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2" returned: 0 in 0.346s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00ce9c5-0887-4176-8c4d-d0be601d0a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2', 'volume_size': 2}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceca6cbd-ba1a-4319-a17a-b5c7e3d79df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:03 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Volume volume-a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2 (a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2): created successfully Sep 28 17:13:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceca6cbd-ba1a-4319-a17a-b5c7e3d79df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Flow 'volume_create_manager' (3b04ff59-9af5-485b-86fb-45c2d04a3246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:03 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-00875cfa-0c80-4814-977f-5478f59a1fb8 tempest-VolumesCloneNegativeTest-584780988 None] Created volume successfully. Sep 28 17:13:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-74ea5ea0-3aa1-47f0-992f-70c9b23b0192 tempest-VolumesExtendTest-1623065699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-74ea5ea0-3aa1-47f0-992f-70c9b23b0192 tempest-VolumesExtendTest-1623065699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:04 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[342fb096-5074-4777-a627-e03c99375683]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-74ea5ea0-3aa1-47f0-992f-70c9b23b0192 tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:04 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee Sep 28 17:13:04 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-79fc26dc-b0e0-4424-84a3-f4c446a375a4 tempest-VolumesCloneNegativeTest-584780988 None] Acquiring lock "cinder-a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-79fc26dc-b0e0-4424-84a3-f4c446a375a4 tempest-VolumesCloneNegativeTest-584780988 None] Lock "cinder-a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-79fc26dc-b0e0-4424-84a3-f4c446a375a4 tempest-VolumesCloneNegativeTest-584780988 None] Acquiring lock "cinder-quobyte-a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-79fc26dc-b0e0-4424-84a3-f4c446a375a4 tempest-VolumesCloneNegativeTest-584780988 None] Lock "cinder-quobyte-a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2" acquired by "delete_volume" :: waited 0.021s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:05 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a6bc35-1d94-4039-ba3b-42f6e9c1a81c]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-79fc26dc-b0e0-4424-84a3-f4c446a375a4 tempest-VolumesCloneNegativeTest-584780988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:05 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-74ea5ea0-3aa1-47f0-992f-70c9b23b0192 tempest-VolumesExtendTest-1623065699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee" returned: 0 in 0.530s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-74ea5ea0-3aa1-47f0-992f-70c9b23b0192 tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee 2G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:05 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2 Sep 28 17:13:05 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-74ea5ea0-3aa1-47f0-992f-70c9b23b0192 tempest-VolumesExtendTest-1623065699 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee 2G" returned: 0 in 0.124s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-74ea5ea0-3aa1-47f0-992f-70c9b23b0192 tempest-VolumesExtendTest-1623065699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.693s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:05 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-74ea5ea0-3aa1-47f0-992f-70c9b23b0192 tempest-VolumesExtendTest-1623065699 None] Extend volume completed successfully. Sep 28 17:13:05 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-79fc26dc-b0e0-4424-84a3-f4c446a375a4 tempest-VolumesCloneNegativeTest-584780988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2" returned: 0 in 0.445s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-79fc26dc-b0e0-4424-84a3-f4c446a375a4 tempest-VolumesCloneNegativeTest-584780988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:05 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2 Sep 28 17:13:05 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:05 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-79fc26dc-b0e0-4424-84a3-f4c446a375a4 tempest-VolumesCloneNegativeTest-584780988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2" returned: 0 in 0.384s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-79fc26dc-b0e0-4424-84a3-f4c446a375a4 tempest-VolumesCloneNegativeTest-584780988 None] Lock "cinder-quobyte-a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2" released by "delete_volume" :: held 0.891s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-79fc26dc-b0e0-4424-84a3-f4c446a375a4 tempest-VolumesCloneNegativeTest-584780988 None] Created reservations ['2b3b6de5-e904-4746-bf9a-60ddae208599', '0dc1a8d6-09c6-4032-9238-a82078480b21', 'aca32eb0-b728-4fbc-aa00-abcafcb04c42', '069b9ec4-8ba9-4766-9b18-1186685d7cad'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-79fc26dc-b0e0-4424-84a3-f4c446a375a4 tempest-VolumesCloneNegativeTest-584780988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-79fc26dc-b0e0-4424-84a3-f4c446a375a4 tempest-VolumesCloneNegativeTest-584780988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-79fc26dc-b0e0-4424-84a3-f4c446a375a4 tempest-VolumesCloneNegativeTest-584780988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-79fc26dc-b0e0-4424-84a3-f4c446a375a4 tempest-VolumesCloneNegativeTest-584780988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-79fc26dc-b0e0-4424-84a3-f4c446a375a4 tempest-VolumesCloneNegativeTest-584780988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-79fc26dc-b0e0-4424-84a3-f4c446a375a4 tempest-VolumesCloneNegativeTest-584780988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:06 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:13:06 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-836241b3-650a-4649-9ac2-6a7252083030 tempest-VolumesExtendTest-1623065699 None] Acquiring lock "cinder-01a3500c-f6c2-45d6-9f15-893605732eee-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-836241b3-650a-4649-9ac2-6a7252083030 tempest-VolumesExtendTest-1623065699 None] Lock "cinder-01a3500c-f6c2-45d6-9f15-893605732eee-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-836241b3-650a-4649-9ac2-6a7252083030 tempest-VolumesExtendTest-1623065699 None] Acquiring lock "cinder-quobyte-01a3500c-f6c2-45d6-9f15-893605732eee" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-836241b3-650a-4649-9ac2-6a7252083030 tempest-VolumesExtendTest-1623065699 None] Lock "cinder-quobyte-01a3500c-f6c2-45d6-9f15-893605732eee" acquired by "delete_volume" :: waited 0.035s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[7720578f-0e94-4a21-89c0-21d45714bf9a]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-836241b3-650a-4649-9ac2-6a7252083030 tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:06 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-79fc26dc-b0e0-4424-84a3-f4c446a375a4 tempest-VolumesCloneNegativeTest-584780988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.443s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-79fc26dc-b0e0-4424-84a3-f4c446a375a4 tempest-VolumesCloneNegativeTest-584780988 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:06 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-79fc26dc-b0e0-4424-84a3-f4c446a375a4 tempest-VolumesCloneNegativeTest-584780988 None] Deleted volume successfully. Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-79fc26dc-b0e0-4424-84a3-f4c446a375a4 tempest-VolumesCloneNegativeTest-584780988 None] Lock "cinder-a39d3d9c-2a3b-4d33-bd75-8987cbad0bb2-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:06 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee Sep 28 17:13:06 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:06 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:13:06 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:07 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-836241b3-650a-4649-9ac2-6a7252083030 tempest-VolumesExtendTest-1623065699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee" returned: 0 in 0.729s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-836241b3-650a-4649-9ac2-6a7252083030 tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:07 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee Sep 28 17:13:07 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:07 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.593s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:13:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:13:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:13:07 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-836241b3-650a-4649-9ac2-6a7252083030 tempest-VolumesExtendTest-1623065699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-01a3500c-f6c2-45d6-9f15-893605732eee" returned: 0 in 0.668s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-836241b3-650a-4649-9ac2-6a7252083030 tempest-VolumesExtendTest-1623065699 None] Lock "cinder-quobyte-01a3500c-f6c2-45d6-9f15-893605732eee" released by "delete_volume" :: held 1.511s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:08 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-836241b3-650a-4649-9ac2-6a7252083030 tempest-VolumesExtendTest-1623065699 None] Created reservations ['cdc7b551-fee9-459d-8cf6-84340b20cfe1', '388f0f8e-409c-43cc-983f-d39938718583', 'a87867b1-f3da-41ae-8ca7-0e836b71d9fa', 'ce7fd230-48ee-4bb8-9c34-a1b71df59751'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-836241b3-650a-4649-9ac2-6a7252083030 tempest-VolumesExtendTest-1623065699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-836241b3-650a-4649-9ac2-6a7252083030 tempest-VolumesExtendTest-1623065699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-836241b3-650a-4649-9ac2-6a7252083030 tempest-VolumesExtendTest-1623065699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-836241b3-650a-4649-9ac2-6a7252083030 tempest-VolumesExtendTest-1623065699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-836241b3-650a-4649-9ac2-6a7252083030 tempest-VolumesExtendTest-1623065699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-836241b3-650a-4649-9ac2-6a7252083030 tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:08 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:13:08 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:08 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-836241b3-650a-4649-9ac2-6a7252083030 tempest-VolumesExtendTest-1623065699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.677s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:08 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-836241b3-650a-4649-9ac2-6a7252083030 tempest-VolumesExtendTest-1623065699 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:09 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-836241b3-650a-4649-9ac2-6a7252083030 tempest-VolumesExtendTest-1623065699 None] Deleted volume successfully. Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-836241b3-650a-4649-9ac2-6a7252083030 tempest-VolumesExtendTest-1623065699 None] Lock "cinder-01a3500c-f6c2-45d6-9f15-893605732eee-delete_volume" released by "delete_volume" :: held 2.704s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Flow 'volume_create_manager' (8642ebb1-49ac-41a9-8d8f-2212ed448496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e3aede-4a9d-40fc-ac05-03c8d4f0cfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e3aede-4a9d-40fc-ac05-03c8d4f0cfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1351634682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69302c01-2376-442b-aefe-583608b49cc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39ae361834249fd8b3d279ca4be971e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:10Z,use_quota=True,user_id='eb55034e91284fa69af2ff4a9f330c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db4a836a-6009-46c9-a7ae-cc09df5092a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db4a836a-6009-46c9-a7ae-cc09df5092a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f14180-26e2-4c05-89f6-bfb399bb8708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f14180-26e2-4c05-89f6-bfb399bb8708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69302c01-2376-442b-aefe-583608b49cc9', 'volume_name': 'volume-69302c01-2376-442b-aefe-583608b49cc9', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ca0f87-561a-447d-aa9f-56899b52218b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ca0f87-561a-447d-aa9f-56899b52218b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113b8ed4-e4a3-44e9-80a6-1bb560636ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:09 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Volume 69302c01-2376-442b-aefe-583608b49cc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69302c01-2376-442b-aefe-583608b49cc9', 'volume_size': 1} Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1351634682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69302c01-2376-442b-aefe-583608b49cc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39ae361834249fd8b3d279ca4be971e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:10Z,use_quota=True,user_id='eb55034e91284fa69af2ff4a9f330c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Creating volume 69302c01-2376-442b-aefe-583608b49cc9 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:09 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:13:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:10 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9 1073741824 Sep 28 17:13:10 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:10 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9 1073741824" returned: 0 in 0.938s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:11 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9 Sep 28 17:13:11 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:11 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9" returned: 0 in 0.449s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:11 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113b8ed4-e4a3-44e9-80a6-1bb560636ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69302c01-2376-442b-aefe-583608b49cc9', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:11 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5532e3-c0c6-48f1-b1ac-09ae8de158cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:11 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Volume volume-69302c01-2376-442b-aefe-583608b49cc9 (69302c01-2376-442b-aefe-583608b49cc9): created successfully Sep 28 17:13:11 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5532e3-c0c6-48f1-b1ac-09ae8de158cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:11 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Flow 'volume_create_manager' (8642ebb1-49ac-41a9-8d8f-2212ed448496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:11 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d34cdf53-25c8-4b3c-aee1-6f1222efa73a tempest-VolumesExtendTest-1623065699 None] Created volume successfully. Sep 28 17:13:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-57966e2a-9152-4488-a794-7ac15ee1c67f tempest-VolumesExtendTest-1623065699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-57966e2a-9152-4488-a794-7ac15ee1c67f tempest-VolumesExtendTest-1623065699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-57966e2a-9152-4488-a794-7ac15ee1c67f tempest-VolumesExtendTest-1623065699 None] Creating offline snapshot e0b59772-bde1-41ee-af38-e3cce0bae862 of volume 69302c01-2376-442b-aefe-583608b49cc9 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:13:12 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0d855d-a58a-476b-b4e3-7fc15163fed8]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57966e2a-9152-4488-a794-7ac15ee1c67f tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:12 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9 Sep 28 17:13:12 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:13 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57966e2a-9152-4488-a794-7ac15ee1c67f tempest-VolumesExtendTest-1623065699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9" returned: 0 in 0.632s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57966e2a-9152-4488-a794-7ac15ee1c67f tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.e0b59772-bde1-41ee-af38-e3cce0bae862 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:13 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.e0b59772-bde1-41ee-af38-e3cce0bae862 1G Sep 28 17:13:13 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4292badd-443d-4ee5-826a-8124e7011049 tempest-VolumesNegativeTest-8885296 None] Acquiring lock "cinder-308a7f18-e013-4af0-a5c1-44e03bf56994-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4292badd-443d-4ee5-826a-8124e7011049 tempest-VolumesNegativeTest-8885296 None] Lock "cinder-308a7f18-e013-4af0-a5c1-44e03bf56994-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4292badd-443d-4ee5-826a-8124e7011049 tempest-VolumesNegativeTest-8885296 None] Acquiring lock "cinder-quobyte-308a7f18-e013-4af0-a5c1-44e03bf56994" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4292badd-443d-4ee5-826a-8124e7011049 tempest-VolumesNegativeTest-8885296 None] Lock "cinder-quobyte-308a7f18-e013-4af0-a5c1-44e03bf56994" acquired by "delete_volume" :: waited 0.030s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:13 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[4965a9f2-c141-418a-9d3b-bff06705faec]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4292badd-443d-4ee5-826a-8124e7011049 tempest-VolumesNegativeTest-8885296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-308a7f18-e013-4af0-a5c1-44e03bf56994 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:13 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-308a7f18-e013-4af0-a5c1-44e03bf56994 Sep 28 17:13:13 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:13 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57966e2a-9152-4488-a794-7ac15ee1c67f tempest-VolumesExtendTest-1623065699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.e0b59772-bde1-41ee-af38-e3cce0bae862 1G" returned: 0 in 0.872s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57966e2a-9152-4488-a794-7ac15ee1c67f tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69302c01-2376-442b-aefe-583608b49cc9 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.e0b59772-bde1-41ee-af38-e3cce0bae862 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:13 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69302c01-2376-442b-aefe-583608b49cc9 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.e0b59772-bde1-41ee-af38-e3cce0bae862 Sep 28 17:13:13 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:14 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4292badd-443d-4ee5-826a-8124e7011049 tempest-VolumesNegativeTest-8885296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-308a7f18-e013-4af0-a5c1-44e03bf56994" returned: 0 in 0.644s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4292badd-443d-4ee5-826a-8124e7011049 tempest-VolumesNegativeTest-8885296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-308a7f18-e013-4af0-a5c1-44e03bf56994 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:14 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-308a7f18-e013-4af0-a5c1-44e03bf56994 Sep 28 17:13:14 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:14 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57966e2a-9152-4488-a794-7ac15ee1c67f tempest-VolumesExtendTest-1623065699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69302c01-2376-442b-aefe-583608b49cc9 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.e0b59772-bde1-41ee-af38-e3cce0bae862" returned: 0 in 0.622s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:14 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-57966e2a-9152-4488-a794-7ac15ee1c67f tempest-VolumesExtendTest-1623065699 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.e0b59772-bde1-41ee-af38-e3cce0bae862 is being set with open permissions: ugo+rw Sep 28 17:13:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57966e2a-9152-4488-a794-7ac15ee1c67f tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.e0b59772-bde1-41ee-af38-e3cce0bae862 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:14 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.e0b59772-bde1-41ee-af38-e3cce0bae862 Sep 28 17:13:14 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:14 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4292badd-443d-4ee5-826a-8124e7011049 tempest-VolumesNegativeTest-8885296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-308a7f18-e013-4af0-a5c1-44e03bf56994" returned: 0 in 0.502s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4292badd-443d-4ee5-826a-8124e7011049 tempest-VolumesNegativeTest-8885296 None] Lock "cinder-quobyte-308a7f18-e013-4af0-a5c1-44e03bf56994" released by "delete_volume" :: held 1.227s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:14 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-4292badd-443d-4ee5-826a-8124e7011049 tempest-VolumesNegativeTest-8885296 None] Created reservations ['371af360-b7ac-4d02-9a5f-53a694ead104', '4db3ec85-4bed-4d0f-9a4c-ef4b0b4425f4', 'dafa827d-b690-4129-8fa2-5c95d2b837c7', '99fbc7f4-8acb-44bc-ab0f-c5e4539bc4e1'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4292badd-443d-4ee5-826a-8124e7011049 tempest-VolumesNegativeTest-8885296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4292badd-443d-4ee5-826a-8124e7011049 tempest-VolumesNegativeTest-8885296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:14 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4292badd-443d-4ee5-826a-8124e7011049 tempest-VolumesNegativeTest-8885296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:14 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4292badd-443d-4ee5-826a-8124e7011049 tempest-VolumesNegativeTest-8885296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4292badd-443d-4ee5-826a-8124e7011049 tempest-VolumesNegativeTest-8885296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4292badd-443d-4ee5-826a-8124e7011049 tempest-VolumesNegativeTest-8885296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:14 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:13:14 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:14 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57966e2a-9152-4488-a794-7ac15ee1c67f tempest-VolumesExtendTest-1623065699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.e0b59772-bde1-41ee-af38-e3cce0bae862" returned: 0 in 0.481s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57966e2a-9152-4488-a794-7ac15ee1c67f tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:15 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.info Sep 28 17:13:15 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:15 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4292badd-443d-4ee5-826a-8124e7011049 tempest-VolumesNegativeTest-8885296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.492s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:15 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-4292badd-443d-4ee5-826a-8124e7011049 tempest-VolumesNegativeTest-8885296 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:15 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-4292badd-443d-4ee5-826a-8124e7011049 tempest-VolumesNegativeTest-8885296 None] Deleted volume successfully. Sep 28 17:13:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4292badd-443d-4ee5-826a-8124e7011049 tempest-VolumesNegativeTest-8885296 None] Lock "cinder-308a7f18-e013-4af0-a5c1-44e03bf56994-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:15 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57966e2a-9152-4488-a794-7ac15ee1c67f tempest-VolumesExtendTest-1623065699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.info" returned: 0 in 0.411s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:15 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-57966e2a-9152-4488-a794-7ac15ee1c67f tempest-VolumesExtendTest-1623065699 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.info is being set with open permissions: ugo+rw Sep 28 17:13:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57966e2a-9152-4488-a794-7ac15ee1c67f tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:15 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.info Sep 28 17:13:15 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:16 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57966e2a-9152-4488-a794-7ac15ee1c67f tempest-VolumesExtendTest-1623065699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.info" returned: 0 in 0.546s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-57966e2a-9152-4488-a794-7ac15ee1c67f tempest-VolumesExtendTest-1623065699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.777s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:16 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-57966e2a-9152-4488-a794-7ac15ee1c67f tempest-VolumesExtendTest-1623065699 None] Create snapshot completed successfully Sep 28 17:13:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f3980c63-bf32-49c9-9acd-64f964a2f435 tempest-VolumesExtendTest-1623065699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f3980c63-bf32-49c9-9acd-64f964a2f435 tempest-VolumesExtendTest-1623065699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:16 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5b6548-fca9-44f9-b719-926b43f6f5cc]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f3980c63-bf32-49c9-9acd-64f964a2f435 tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:17 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9 Sep 28 17:13:17 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:17 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f3980c63-bf32-49c9-9acd-64f964a2f435 tempest-VolumesExtendTest-1623065699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9" returned: 0 in 0.617s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f3980c63-bf32-49c9-9acd-64f964a2f435 tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.e0b59772-bde1-41ee-af38-e3cce0bae862 2G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f3980c63-bf32-49c9-9acd-64f964a2f435 tempest-VolumesExtendTest-1623065699 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.e0b59772-bde1-41ee-af38-e3cce0bae862 2G" returned: 0 in 0.236s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f3980c63-bf32-49c9-9acd-64f964a2f435 tempest-VolumesExtendTest-1623065699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.915s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:17 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-f3980c63-bf32-49c9-9acd-64f964a2f435 tempest-VolumesExtendTest-1623065699 None] Extend volume completed successfully. Sep 28 17:13:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fc8aa4b8-0d71-4d53-8c59-61cdcd4514e9 tempest-VolumesExtendTest-1623065699 None] Acquiring lock "cinder-e0b59772-bde1-41ee-af38-e3cce0bae862-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fc8aa4b8-0d71-4d53-8c59-61cdcd4514e9 tempest-VolumesExtendTest-1623065699 None] Lock "cinder-e0b59772-bde1-41ee-af38-e3cce0bae862-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fc8aa4b8-0d71-4d53-8c59-61cdcd4514e9 tempest-VolumesExtendTest-1623065699 None] Acquiring lock "cinder-quobyte-69302c01-2376-442b-aefe-583608b49cc9" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fc8aa4b8-0d71-4d53-8c59-61cdcd4514e9 tempest-VolumesExtendTest-1623065699 None] Lock "cinder-quobyte-69302c01-2376-442b-aefe-583608b49cc9" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fc8aa4b8-0d71-4d53-8c59-61cdcd4514e9 tempest-VolumesExtendTest-1623065699 None] Acquiring lock "cinder-quobyte-e0b59772-bde1-41ee-af38-e3cce0bae862" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fc8aa4b8-0d71-4d53-8c59-61cdcd4514e9 tempest-VolumesExtendTest-1623065699 None] Lock "cinder-quobyte-e0b59772-bde1-41ee-af38-e3cce0bae862" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:18 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-fc8aa4b8-0d71-4d53-8c59-61cdcd4514e9 tempest-VolumesExtendTest-1623065699 None] Deleting offline snapshot e0b59772-bde1-41ee-af38-e3cce0bae862 of volume 69302c01-2376-442b-aefe-583608b49cc9 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:13:18 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-fc8aa4b8-0d71-4d53-8c59-61cdcd4514e9 tempest-VolumesExtendTest-1623065699 None] snapshot_file for this snap is: volume-69302c01-2376-442b-aefe-583608b49cc9.e0b59772-bde1-41ee-af38-e3cce0bae862 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:13:18 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8f6c61-0abf-42e0-9d63-54c25f4841d0]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fc8aa4b8-0d71-4d53-8c59-61cdcd4514e9 tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.e0b59772-bde1-41ee-af38-e3cce0bae862 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:18 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.e0b59772-bde1-41ee-af38-e3cce0bae862 Sep 28 17:13:18 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:19 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fc8aa4b8-0d71-4d53-8c59-61cdcd4514e9 tempest-VolumesExtendTest-1623065699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.e0b59772-bde1-41ee-af38-e3cce0bae862" returned: 0 in 0.584s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-fc8aa4b8-0d71-4d53-8c59-61cdcd4514e9 tempest-VolumesExtendTest-1623065699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69302c01-2376-442b-aefe-583608b49cc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:19 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d702d3-dfbc-4d7b-a0f8-d38cb6a355cc]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fc8aa4b8-0d71-4d53-8c59-61cdcd4514e9 tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:19 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9 Sep 28 17:13:19 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:19 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fc8aa4b8-0d71-4d53-8c59-61cdcd4514e9 tempest-VolumesExtendTest-1623065699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9" returned: 0 in 0.663s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fc8aa4b8-0d71-4d53-8c59-61cdcd4514e9 tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.e0b59772-bde1-41ee-af38-e3cce0bae862 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:19 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.e0b59772-bde1-41ee-af38-e3cce0bae862 Sep 28 17:13:19 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:20 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fc8aa4b8-0d71-4d53-8c59-61cdcd4514e9 tempest-VolumesExtendTest-1623065699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.e0b59772-bde1-41ee-af38-e3cce0bae862" returned: 0 in 0.770s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fc8aa4b8-0d71-4d53-8c59-61cdcd4514e9 tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.e0b59772-bde1-41ee-af38-e3cce0bae862 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:20 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.e0b59772-bde1-41ee-af38-e3cce0bae862 Sep 28 17:13:20 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:20 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fc8aa4b8-0d71-4d53-8c59-61cdcd4514e9 tempest-VolumesExtendTest-1623065699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9.e0b59772-bde1-41ee-af38-e3cce0bae862" returned: 0 in 0.430s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fc8aa4b8-0d71-4d53-8c59-61cdcd4514e9 tempest-VolumesExtendTest-1623065699 None] Lock "cinder-quobyte-e0b59772-bde1-41ee-af38-e3cce0bae862" released by "_delete_snapshot" :: held 2.739s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fc8aa4b8-0d71-4d53-8c59-61cdcd4514e9 tempest-VolumesExtendTest-1623065699 None] Lock "cinder-quobyte-69302c01-2376-442b-aefe-583608b49cc9" released by "delete_snapshot" :: held 2.789s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:21 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-fc8aa4b8-0d71-4d53-8c59-61cdcd4514e9 tempest-VolumesExtendTest-1623065699 None] Created reservations ['9bdf4114-4434-47ea-9e2f-30e8fc6d28d8', 'eb410c9b-d3c2-414d-ab07-f1fb8529f8bb', '80abb249-ff56-49c2-877a-1b261fdfea9a', 'ecc270cc-1fe4-4009-a548-1dbea1a54cc5'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:21 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-fc8aa4b8-0d71-4d53-8c59-61cdcd4514e9 tempest-VolumesExtendTest-1623065699 None] Delete snapshot completed successfully. Sep 28 17:13:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fc8aa4b8-0d71-4d53-8c59-61cdcd4514e9 tempest-VolumesExtendTest-1623065699 None] Lock "cinder-e0b59772-bde1-41ee-af38-e3cce0bae862-delete_snapshot" released by "delete_snapshot" :: held 3.126s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:21 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Flow 'volume_create_manager' (301b0646-3846-42c0-a469-47bee0a2e0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c914c4eb-cbc7-4c73-87d2-f315cb282ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-86d9efda-22a3-43d5-9a7d-682be50a6a9a tempest-VolumesExtendTest-1623065699 None] Acquiring lock "cinder-69302c01-2376-442b-aefe-583608b49cc9-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c914c4eb-cbc7-4c73-87d2-f315cb282ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1585754311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b25fac37-baff-4065-b2b7-d65575303576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b235b95c27ed455eb7ea97d47131e718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:22Z,use_quota=True,user_id='79b3107205714c8aaa2b8ad2c4972282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161e2feb-5827-43ef-b312-b41f7cbdad58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161e2feb-5827-43ef-b312-b41f7cbdad58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91aa2949-f274-450d-89a4-d342e2cfb00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91aa2949-f274-450d-89a4-d342e2cfb00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b25fac37-baff-4065-b2b7-d65575303576', 'volume_name': 'volume-b25fac37-baff-4065-b2b7-d65575303576', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3af8493-2adf-41ee-a8a9-72ea9eb0d5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3af8493-2adf-41ee-a8a9-72ea9eb0d5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af2deac-00fc-4585-bb5c-f4fe97a36016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:22 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Volume b25fac37-baff-4065-b2b7-d65575303576: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b25fac37-baff-4065-b2b7-d65575303576', 'volume_size': 1} Sep 28 17:13:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:22 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1585754311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b25fac37-baff-4065-b2b7-d65575303576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b235b95c27ed455eb7ea97d47131e718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:22Z,use_quota=True,user_id='79b3107205714c8aaa2b8ad2c4972282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:22 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Creating volume b25fac37-baff-4065-b2b7-d65575303576 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:22 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:22 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:22 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:22 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:13:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:22 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-86d9efda-22a3-43d5-9a7d-682be50a6a9a tempest-VolumesExtendTest-1623065699 None] Lock "cinder-69302c01-2376-442b-aefe-583608b49cc9-delete_volume" acquired by "delete_volume" :: waited 0.180s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:22 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576 1073741824 Sep 28 17:13:22 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:22 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-86d9efda-22a3-43d5-9a7d-682be50a6a9a tempest-VolumesExtendTest-1623065699 None] Acquiring lock "cinder-quobyte-69302c01-2376-442b-aefe-583608b49cc9" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:22 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-86d9efda-22a3-43d5-9a7d-682be50a6a9a tempest-VolumesExtendTest-1623065699 None] Lock "cinder-quobyte-69302c01-2376-442b-aefe-583608b49cc9" acquired by "delete_volume" :: waited 0.019s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:22 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[643437e8-3da9-4756-b646-7a324111ad3f]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-86d9efda-22a3-43d5-9a7d-682be50a6a9a tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:22 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9 Sep 28 17:13:22 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:22 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576 1073741824" returned: 0 in 0.904s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:23 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576 Sep 28 17:13:23 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:23 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-86d9efda-22a3-43d5-9a7d-682be50a6a9a tempest-VolumesExtendTest-1623065699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9" returned: 0 in 0.821s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-86d9efda-22a3-43d5-9a7d-682be50a6a9a tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:23 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9 Sep 28 17:13:23 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:23 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576" returned: 0 in 0.412s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:23 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:23 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af2deac-00fc-4585-bb5c-f4fe97a36016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b25fac37-baff-4065-b2b7-d65575303576', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:23 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b43343-3052-4c07-a85f-5bdd00937fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:23 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Volume volume-b25fac37-baff-4065-b2b7-d65575303576 (b25fac37-baff-4065-b2b7-d65575303576): created successfully Sep 28 17:13:23 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b43343-3052-4c07-a85f-5bdd00937fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:23 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Flow 'volume_create_manager' (301b0646-3846-42c0-a469-47bee0a2e0d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:23 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:23 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-3b11a957-d911-4ebc-8f69-3dcac6ff3153 tempest-VolumesSnapshotListTestJSON-1854537221 None] Created volume successfully. Sep 28 17:13:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-86d9efda-22a3-43d5-9a7d-682be50a6a9a tempest-VolumesExtendTest-1623065699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-69302c01-2376-442b-aefe-583608b49cc9" returned: 0 in 0.438s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-86d9efda-22a3-43d5-9a7d-682be50a6a9a tempest-VolumesExtendTest-1623065699 None] Lock "cinder-quobyte-69302c01-2376-442b-aefe-583608b49cc9" released by "delete_volume" :: held 1.371s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:23 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-86d9efda-22a3-43d5-9a7d-682be50a6a9a tempest-VolumesExtendTest-1623065699 None] Created reservations ['6faacc14-5c3f-41b7-8bbc-6a94e43ef2e3', 'f88a7597-17ae-4f96-aba2-77f1b72bc4d3', '5df64dd3-9cb5-405a-8503-76f625245c34', '069cb966-b103-406e-a9f0-ec7ce87cce93'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-86d9efda-22a3-43d5-9a7d-682be50a6a9a tempest-VolumesExtendTest-1623065699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-86d9efda-22a3-43d5-9a7d-682be50a6a9a tempest-VolumesExtendTest-1623065699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:23 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-86d9efda-22a3-43d5-9a7d-682be50a6a9a tempest-VolumesExtendTest-1623065699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:23 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-86d9efda-22a3-43d5-9a7d-682be50a6a9a tempest-VolumesExtendTest-1623065699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-86d9efda-22a3-43d5-9a7d-682be50a6a9a tempest-VolumesExtendTest-1623065699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-86d9efda-22a3-43d5-9a7d-682be50a6a9a tempest-VolumesExtendTest-1623065699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:23 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:13:23 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:23 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-86d9efda-22a3-43d5-9a7d-682be50a6a9a tempest-VolumesExtendTest-1623065699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.285s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:23 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-86d9efda-22a3-43d5-9a7d-682be50a6a9a tempest-VolumesExtendTest-1623065699 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:23 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-86d9efda-22a3-43d5-9a7d-682be50a6a9a tempest-VolumesExtendTest-1623065699 None] Deleted volume successfully. Sep 28 17:13:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-86d9efda-22a3-43d5-9a7d-682be50a6a9a tempest-VolumesExtendTest-1623065699 None] Lock "cinder-69302c01-2376-442b-aefe-583608b49cc9-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8fa6481d-464d-4d6d-ade0-d84ae1ba8bab tempest-VolumesSnapshotListTestJSON-1854537221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8fa6481d-464d-4d6d-ade0-d84ae1ba8bab tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-8fa6481d-464d-4d6d-ade0-d84ae1ba8bab tempest-VolumesSnapshotListTestJSON-1854537221 None] Creating offline snapshot 3c25f962-ba59-4451-b566-e28d5c779878 of volume b25fac37-baff-4065-b2b7-d65575303576 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:13:24 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc8618c-1e15-4cf1-bddb-ad5b3213ec0b]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8fa6481d-464d-4d6d-ade0-d84ae1ba8bab tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:24 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576 Sep 28 17:13:24 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:25 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8fa6481d-464d-4d6d-ade0-d84ae1ba8bab tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576" returned: 0 in 0.642s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8fa6481d-464d-4d6d-ade0-d84ae1ba8bab tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:25 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878 1G Sep 28 17:13:25 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:25 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8fa6481d-464d-4d6d-ade0-d84ae1ba8bab tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878 1G" returned: 0 in 0.666s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8fa6481d-464d-4d6d-ade0-d84ae1ba8bab tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b25fac37-baff-4065-b2b7-d65575303576 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:25 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b25fac37-baff-4065-b2b7-d65575303576 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878 Sep 28 17:13:25 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:26 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8fa6481d-464d-4d6d-ade0-d84ae1ba8bab tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b25fac37-baff-4065-b2b7-d65575303576 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878" returned: 0 in 0.402s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:26 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-8fa6481d-464d-4d6d-ade0-d84ae1ba8bab tempest-VolumesSnapshotListTestJSON-1854537221 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878 is being set with open permissions: ugo+rw Sep 28 17:13:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8fa6481d-464d-4d6d-ade0-d84ae1ba8bab tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:26 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878 Sep 28 17:13:26 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:26 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8fa6481d-464d-4d6d-ade0-d84ae1ba8bab tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878" returned: 0 in 0.376s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8fa6481d-464d-4d6d-ade0-d84ae1ba8bab tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:26 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.info Sep 28 17:13:26 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:26 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8fa6481d-464d-4d6d-ade0-d84ae1ba8bab tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.info" returned: 0 in 0.321s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:26 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-8fa6481d-464d-4d6d-ade0-d84ae1ba8bab tempest-VolumesSnapshotListTestJSON-1854537221 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.info is being set with open permissions: ugo+rw Sep 28 17:13:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8fa6481d-464d-4d6d-ade0-d84ae1ba8bab tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:26 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.info Sep 28 17:13:26 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:27 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8fa6481d-464d-4d6d-ade0-d84ae1ba8bab tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.info" returned: 0 in 0.397s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8fa6481d-464d-4d6d-ade0-d84ae1ba8bab tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.961s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:27 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-8fa6481d-464d-4d6d-ade0-d84ae1ba8bab tempest-VolumesSnapshotListTestJSON-1854537221 None] Create snapshot completed successfully Sep 28 17:13:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a11209b5-b224-49cc-ba0a-42cdc660ed18 tempest-VolumesSnapshotListTestJSON-1854537221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a11209b5-b224-49cc-ba0a-42cdc660ed18 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-a11209b5-b224-49cc-ba0a-42cdc660ed18 tempest-VolumesSnapshotListTestJSON-1854537221 None] Creating offline snapshot 6bff0055-f7f7-4530-875a-4b8f3c0c497a of volume b25fac37-baff-4065-b2b7-d65575303576 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:13:28 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[943f387f-102d-401c-b540-a5778632d25e]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a11209b5-b224-49cc-ba0a-42cdc660ed18 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:28 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878 Sep 28 17:13:28 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:29 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a11209b5-b224-49cc-ba0a-42cdc660ed18 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878" returned: 0 in 0.876s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-a11209b5-b224-49cc-ba0a-42cdc660ed18 tempest-VolumesSnapshotListTestJSON-1854537221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b25fac37-baff-4065-b2b7-d65575303576(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a11209b5-b224-49cc-ba0a-42cdc660ed18 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:29 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a 1G Sep 28 17:13:29 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:30 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a11209b5-b224-49cc-ba0a-42cdc660ed18 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a 1G" returned: 0 in 1.004s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a11209b5-b224-49cc-ba0a-42cdc660ed18 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:30 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a Sep 28 17:13:30 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:30 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a11209b5-b224-49cc-ba0a-42cdc660ed18 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a" returned: 0 in 0.537s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:30 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-a11209b5-b224-49cc-ba0a-42cdc660ed18 tempest-VolumesSnapshotListTestJSON-1854537221 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a is being set with open permissions: ugo+rw Sep 28 17:13:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a11209b5-b224-49cc-ba0a-42cdc660ed18 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:30 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a Sep 28 17:13:30 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:31 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a11209b5-b224-49cc-ba0a-42cdc660ed18 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a" returned: 0 in 0.759s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a11209b5-b224-49cc-ba0a-42cdc660ed18 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.481s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:31 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a11209b5-b224-49cc-ba0a-42cdc660ed18 tempest-VolumesSnapshotListTestJSON-1854537221 None] Create snapshot completed successfully Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Flow 'volume_create_manager' (a2f8ca10-4caa-434b-bac6-23e2aea182bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72450a3a-9314-4bf5-bcc6-525fb9d90921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72450a3a-9314-4bf5-bcc6-525fb9d90921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1525274984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac00b9a-59f7-43ed-b9ca-e775f7d010e8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a47cfc0470734f5a9cf32d38abedcf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:32Z,use_quota=True,user_id='2819d7ed92b34793956b001a87a2f252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7366abc0-cb80-45b4-b790-0318b698ce78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7366abc0-cb80-45b4-b790-0318b698ce78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be51135f-2c3a-4438-96a9-9785785a38d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be51135f-2c3a-4438-96a9-9785785a38d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ac00b9a-59f7-43ed-b9ca-e775f7d010e8', 'volume_name': 'volume-7ac00b9a-59f7-43ed-b9ca-e775f7d010e8', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d14916-1a01-42e3-9e06-2068c971fc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d14916-1a01-42e3-9e06-2068c971fc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7e80a9-ed88-45ba-9eb5-3a9ea6e17542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:32 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Volume 7ac00b9a-59f7-43ed-b9ca-e775f7d010e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ac00b9a-59f7-43ed-b9ca-e775f7d010e8', 'volume_size': 1} Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1525274984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac00b9a-59f7-43ed-b9ca-e775f7d010e8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a47cfc0470734f5a9cf32d38abedcf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:32Z,use_quota=True,user_id='2819d7ed92b34793956b001a87a2f252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Creating volume 7ac00b9a-59f7-43ed-b9ca-e775f7d010e8 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:32 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ac00b9a-59f7-43ed-b9ca-e775f7d010e8 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:32 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ac00b9a-59f7-43ed-b9ca-e775f7d010e8 1073741824 Sep 28 17:13:32 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=93,cinder:UPDATE=100,cinder:DELETE=9,cinder:INSERT=30 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:13:32 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:UPDATE=103,cinder:INSERT=29,cinder:DELETE=9,cinder:SELECT=74 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:13:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4a0ca145-9198-4104-919b-0dae33923120 tempest-VolumesSnapshotListTestJSON-1854537221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:33 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ac00b9a-59f7-43ed-b9ca-e775f7d010e8 1073741824" returned: 0 in 1.030s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ac00b9a-59f7-43ed-b9ca-e775f7d010e8 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:33 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ac00b9a-59f7-43ed-b9ca-e775f7d010e8 Sep 28 17:13:33 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:34 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ac00b9a-59f7-43ed-b9ca-e775f7d010e8" returned: 0 in 0.402s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4a0ca145-9198-4104-919b-0dae33923120 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.077s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-4a0ca145-9198-4104-919b-0dae33923120 tempest-VolumesSnapshotListTestJSON-1854537221 None] Creating offline snapshot d0f9cade-edcd-4f7d-a181-98c0a1293ae7 of volume b25fac37-baff-4065-b2b7-d65575303576 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7e80a9-ed88-45ba-9eb5-3a9ea6e17542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ac00b9a-59f7-43ed-b9ca-e775f7d010e8', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a80c12a-ff7a-4a11-b079-fd032328de53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee975f7-cb60-49ba-afc5-1c72b91fca3e]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4a0ca145-9198-4104-919b-0dae33923120 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:34 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Volume volume-7ac00b9a-59f7-43ed-b9ca-e775f7d010e8 (7ac00b9a-59f7-43ed-b9ca-e775f7d010e8): created successfully Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a80c12a-ff7a-4a11-b079-fd032328de53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Flow 'volume_create_manager' (a2f8ca10-4caa-434b-bac6-23e2aea182bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:34 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e75f9bc6-ad2b-4957-9ec1-a62730046884 tempest-VolumesGetTest-661166036 None] Created volume successfully. Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:34 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a Sep 28 17:13:34 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Flow 'volume_create_manager' (1313d58e-1ccf-4f64-aa02-79853a31154f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cde2d51-3383-40a5-8197-6211d9d08b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cde2d51-3383-40a5-8197-6211d9d08b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-231171417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe0034d-55a5-414c-83e6-353e4c101e32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1597d278c62544538f0172cd1292f3dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:35Z,use_quota=True,user_id='e598fcac75cb44488aca25b98e029a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f687d685-aef9-4074-badb-2a5125b70cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f687d685-aef9-4074-badb-2a5125b70cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ffc132-bd2e-4e25-a644-7678749e7ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ffc132-bd2e-4e25-a644-7678749e7ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebe0034d-55a5-414c-83e6-353e4c101e32', 'volume_name': 'volume-ebe0034d-55a5-414c-83e6-353e4c101e32', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501a51fd-22a4-4fb8-9d4d-e6e2d652f5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501a51fd-22a4-4fb8-9d4d-e6e2d652f5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f444af3c-ec38-46f1-8704-79ab4e9eb8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:34 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Volume ebe0034d-55a5-414c-83e6-353e4c101e32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebe0034d-55a5-414c-83e6-353e4c101e32', 'volume_size': 1} Sep 28 17:13:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:35 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4a0ca145-9198-4104-919b-0dae33923120 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a" returned: 0 in 0.888s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-4a0ca145-9198-4104-919b-0dae33923120 tempest-VolumesSnapshotListTestJSON-1854537221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b25fac37-baff-4065-b2b7-d65575303576(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4a0ca145-9198-4104-919b-0dae33923120 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.d0f9cade-edcd-4f7d-a181-98c0a1293ae7 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:35 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.d0f9cade-edcd-4f7d-a181-98c0a1293ae7 1G Sep 28 17:13:35 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:35 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4a0ca145-9198-4104-919b-0dae33923120 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.d0f9cade-edcd-4f7d-a181-98c0a1293ae7 1G" returned: 0 in 0.725s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4a0ca145-9198-4104-919b-0dae33923120 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.d0f9cade-edcd-4f7d-a181-98c0a1293ae7 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:35 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.d0f9cade-edcd-4f7d-a181-98c0a1293ae7 Sep 28 17:13:35 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:36 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4a0ca145-9198-4104-919b-0dae33923120 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.d0f9cade-edcd-4f7d-a181-98c0a1293ae7" returned: 0 in 0.378s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:36 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-4a0ca145-9198-4104-919b-0dae33923120 tempest-VolumesSnapshotListTestJSON-1854537221 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.d0f9cade-edcd-4f7d-a181-98c0a1293ae7 is being set with open permissions: ugo+rw Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4a0ca145-9198-4104-919b-0dae33923120 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.d0f9cade-edcd-4f7d-a181-98c0a1293ae7 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:36 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.d0f9cade-edcd-4f7d-a181-98c0a1293ae7 Sep 28 17:13:36 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:36 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4a0ca145-9198-4104-919b-0dae33923120 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.d0f9cade-edcd-4f7d-a181-98c0a1293ae7" returned: 0 in 0.344s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4a0ca145-9198-4104-919b-0dae33923120 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.589s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.754s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-231171417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe0034d-55a5-414c-83e6-353e4c101e32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1597d278c62544538f0172cd1292f3dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:35Z,use_quota=True,user_id='e598fcac75cb44488aca25b98e029a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Creating volume ebe0034d-55a5-414c-83e6-353e4c101e32 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:36 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:36 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32 1073741824 Sep 28 17:13:36 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:36 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-4a0ca145-9198-4104-919b-0dae33923120 tempest-VolumesSnapshotListTestJSON-1854537221 None] Create snapshot completed successfully Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Flow 'volume_create_manager' (037934b0-1360-4a8d-85bc-355a4b3bfe0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf8595a-f8f8-438e-8965-947a978ec5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf8595a-f8f8-438e-8965-947a978ec5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-653307900',display_name='tempest-VolumesGetTest-Volume-20268826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f427e6-c11f-4c3a-b105-5bb6642b88f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47cfc0470734f5a9cf32d38abedcf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:37Z,use_quota=True,user_id='2819d7ed92b34793956b001a87a2f252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd8bcfe-698f-4335-a2eb-14e1d7470e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd8bcfe-698f-4335-a2eb-14e1d7470e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5afbd8fa-5cec-4582-9577-a047f0ec052e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5afbd8fa-5cec-4582-9577-a047f0ec052e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17f427e6-c11f-4c3a-b105-5bb6642b88f6', 'volume_name': 'volume-17f427e6-c11f-4c3a-b105-5bb6642b88f6', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb1dd93-6e61-4a5b-a9ca-e599ccb98ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb1dd93-6e61-4a5b-a9ca-e599ccb98ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df9a3bb-7af9-4030-b5fa-219ac6ece39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:36 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Volume 17f427e6-c11f-4c3a-b105-5bb6642b88f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17f427e6-c11f-4c3a-b105-5bb6642b88f6', 'volume_size': 1} Sep 28 17:13:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:37 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32 1073741824" returned: 0 in 0.561s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:37 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32 Sep 28 17:13:37 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:37 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32" returned: 0 in 0.399s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.848s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-653307900',display_name='tempest-VolumesGetTest-Volume-20268826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f427e6-c11f-4c3a-b105-5bb6642b88f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47cfc0470734f5a9cf32d38abedcf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:37Z,use_quota=True,user_id='2819d7ed92b34793956b001a87a2f252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Creating volume 17f427e6-c11f-4c3a-b105-5bb6642b88f6 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:37 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:13:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17f427e6-c11f-4c3a-b105-5bb6642b88f6 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:37 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17f427e6-c11f-4c3a-b105-5bb6642b88f6 1073741824 Sep 28 17:13:37 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f444af3c-ec38-46f1-8704-79ab4e9eb8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebe0034d-55a5-414c-83e6-353e4c101e32', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77040d8e-ed2d-4617-baa2-c7264642d70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:37 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Volume volume-ebe0034d-55a5-414c-83e6-353e4c101e32 (ebe0034d-55a5-414c-83e6-353e4c101e32): created successfully Sep 28 17:13:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77040d8e-ed2d-4617-baa2-c7264642d70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Flow 'volume_create_manager' (1313d58e-1ccf-4f64-aa02-79853a31154f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:37 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-ca6ba414-0c49-4708-b73c-c980ec88cb02 tempest-VolumesSnapshotTestJSON-999222795 None] Created volume successfully. Sep 28 17:13:38 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17f427e6-c11f-4c3a-b105-5bb6642b88f6 1073741824" returned: 0 in 0.674s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17f427e6-c11f-4c3a-b105-5bb6642b88f6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:38 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17f427e6-c11f-4c3a-b105-5bb6642b88f6 Sep 28 17:13:38 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] Acquiring lock "cinder-d0f9cade-edcd-4f7d-a181-98c0a1293ae7-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "cinder-d0f9cade-edcd-4f7d-a181-98c0a1293ae7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] Acquiring lock "cinder-quobyte-b25fac37-baff-4065-b2b7-d65575303576" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "cinder-quobyte-b25fac37-baff-4065-b2b7-d65575303576" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] Acquiring lock "cinder-quobyte-d0f9cade-edcd-4f7d-a181-98c0a1293ae7" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "cinder-quobyte-d0f9cade-edcd-4f7d-a181-98c0a1293ae7" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] Deleting offline snapshot d0f9cade-edcd-4f7d-a181-98c0a1293ae7 of volume b25fac37-baff-4065-b2b7-d65575303576 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:13:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] snapshot_file for this snap is: volume-b25fac37-baff-4065-b2b7-d65575303576.d0f9cade-edcd-4f7d-a181-98c0a1293ae7 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:13:38 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3aabb1-5c87-4937-93fb-f4128d3ff1e6]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.d0f9cade-edcd-4f7d-a181-98c0a1293ae7 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:39 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17f427e6-c11f-4c3a-b105-5bb6642b88f6" returned: 0 in 0.563s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:39 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df9a3bb-7af9-4030-b5fa-219ac6ece39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17f427e6-c11f-4c3a-b105-5bb6642b88f6', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:39 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6952a3-db58-4d14-a355-66dae89392f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:39 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Volume volume-17f427e6-c11f-4c3a-b105-5bb6642b88f6 (17f427e6-c11f-4c3a-b105-5bb6642b88f6): created successfully Sep 28 17:13:39 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6952a3-db58-4d14-a355-66dae89392f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:39 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Flow 'volume_create_manager' (037934b0-1360-4a8d-85bc-355a4b3bfe0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:39 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-b8bebed7-0c4d-4554-8cfc-8705942dddfd tempest-VolumesGetTest-661166036 None] Created volume successfully. Sep 28 17:13:39 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.d0f9cade-edcd-4f7d-a181-98c0a1293ae7 Sep 28 17:13:39 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:39 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.d0f9cade-edcd-4f7d-a181-98c0a1293ae7" returned: 0 in 0.631s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b25fac37-baff-4065-b2b7-d65575303576(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:39 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0b3d24-e95f-4f6b-8acc-cea8290b9de8]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b78fcfc1-5747-4073-a3c5-795722bbce9a tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b78fcfc1-5747-4073-a3c5-795722bbce9a tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-b78fcfc1-5747-4073-a3c5-795722bbce9a tempest-VolumesSnapshotTestJSON-999222795 None] Creating offline snapshot d264c76b-7bd8-4792-ac2a-44e69ea8389a of volume ebe0034d-55a5-414c-83e6-353e4c101e32 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:13:39 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b694f807-379c-4d7c-a062-b031d7a4a7c6]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b78fcfc1-5747-4073-a3c5-795722bbce9a tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:39 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a Sep 28 17:13:39 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:39 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32 Sep 28 17:13:39 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:40 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a" returned: 0 in 0.632s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:40 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b25fac37-baff-4065-b2b7-d65575303576(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.d0f9cade-edcd-4f7d-a181-98c0a1293ae7 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:40 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b78fcfc1-5747-4073-a3c5-795722bbce9a tempest-VolumesSnapshotTestJSON-999222795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32" returned: 0 in 0.568s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b78fcfc1-5747-4073-a3c5-795722bbce9a tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.d264c76b-7bd8-4792-ac2a-44e69ea8389a 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:40 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.d0f9cade-edcd-4f7d-a181-98c0a1293ae7 Sep 28 17:13:40 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:40 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.d264c76b-7bd8-4792-ac2a-44e69ea8389a 1G Sep 28 17:13:40 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a3d4f233-fc59-40f4-b10f-f74862a88ed5 tempest-VolumesGetTest-661166036 None] Acquiring lock "cinder-17f427e6-c11f-4c3a-b105-5bb6642b88f6-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a3d4f233-fc59-40f4-b10f-f74862a88ed5 tempest-VolumesGetTest-661166036 None] Lock "cinder-17f427e6-c11f-4c3a-b105-5bb6642b88f6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a3d4f233-fc59-40f4-b10f-f74862a88ed5 tempest-VolumesGetTest-661166036 None] Acquiring lock "cinder-quobyte-17f427e6-c11f-4c3a-b105-5bb6642b88f6" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a3d4f233-fc59-40f4-b10f-f74862a88ed5 tempest-VolumesGetTest-661166036 None] Lock "cinder-quobyte-17f427e6-c11f-4c3a-b105-5bb6642b88f6" acquired by "delete_volume" :: waited 0.040s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:40 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06f7f58-5bf9-4e7f-b1da-6d6b87345061]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3d4f233-fc59-40f4-b10f-f74862a88ed5 tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17f427e6-c11f-4c3a-b105-5bb6642b88f6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:40 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17f427e6-c11f-4c3a-b105-5bb6642b88f6 Sep 28 17:13:40 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:40 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.d0f9cade-edcd-4f7d-a181-98c0a1293ae7" returned: 0 in 0.640s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.d0f9cade-edcd-4f7d-a181-98c0a1293ae7 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:40 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.d0f9cade-edcd-4f7d-a181-98c0a1293ae7 Sep 28 17:13:40 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:41 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3d4f233-fc59-40f4-b10f-f74862a88ed5 tempest-VolumesGetTest-661166036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17f427e6-c11f-4c3a-b105-5bb6642b88f6" returned: 0 in 0.459s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3d4f233-fc59-40f4-b10f-f74862a88ed5 tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17f427e6-c11f-4c3a-b105-5bb6642b88f6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:41 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b78fcfc1-5747-4073-a3c5-795722bbce9a tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.d264c76b-7bd8-4792-ac2a-44e69ea8389a 1G" returned: 0 in 0.755s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b78fcfc1-5747-4073-a3c5-795722bbce9a tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebe0034d-55a5-414c-83e6-353e4c101e32 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.d264c76b-7bd8-4792-ac2a-44e69ea8389a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:41 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17f427e6-c11f-4c3a-b105-5bb6642b88f6 Sep 28 17:13:41 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:41 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebe0034d-55a5-414c-83e6-353e4c101e32 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.d264c76b-7bd8-4792-ac2a-44e69ea8389a Sep 28 17:13:41 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:41 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.d0f9cade-edcd-4f7d-a181-98c0a1293ae7" returned: 0 in 0.357s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "cinder-quobyte-d0f9cade-edcd-4f7d-a181-98c0a1293ae7" released by "_delete_snapshot" :: held 2.425s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "cinder-quobyte-b25fac37-baff-4065-b2b7-d65575303576" released by "delete_snapshot" :: held 2.485s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:41 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3d4f233-fc59-40f4-b10f-f74862a88ed5 tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17f427e6-c11f-4c3a-b105-5bb6642b88f6" returned: 0 in 0.373s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a3d4f233-fc59-40f4-b10f-f74862a88ed5 tempest-VolumesGetTest-661166036 None] Lock "cinder-quobyte-17f427e6-c11f-4c3a-b105-5bb6642b88f6" released by "delete_volume" :: held 0.894s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:41 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] Created reservations ['762d0731-699c-43a3-9057-2bfa33a71adf', '7f08ef68-050c-4169-81b2-8d41537878e6', 'a96beada-0b6d-445d-93d8-df9d1257b71c', 'c7b6a12e-d535-4a1b-a68f-b28fd6fc51d1'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:41 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b78fcfc1-5747-4073-a3c5-795722bbce9a tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebe0034d-55a5-414c-83e6-353e4c101e32 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.d264c76b-7bd8-4792-ac2a-44e69ea8389a" returned: 0 in 0.417s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:41 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-b78fcfc1-5747-4073-a3c5-795722bbce9a tempest-VolumesSnapshotTestJSON-999222795 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.d264c76b-7bd8-4792-ac2a-44e69ea8389a is being set with open permissions: ugo+rw Sep 28 17:13:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b78fcfc1-5747-4073-a3c5-795722bbce9a tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.d264c76b-7bd8-4792-ac2a-44e69ea8389a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:41 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.d264c76b-7bd8-4792-ac2a-44e69ea8389a Sep 28 17:13:41 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:41 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] Delete snapshot completed successfully. Sep 28 17:13:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f7949dab-b06f-4c04-a743-b498dab65525 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "cinder-d0f9cade-edcd-4f7d-a181-98c0a1293ae7-delete_snapshot" released by "delete_snapshot" :: held 2.802s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:41 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-a3d4f233-fc59-40f4-b10f-f74862a88ed5 tempest-VolumesGetTest-661166036 None] Created reservations ['7f121a91-6b12-429b-a7f8-7f0da69e8b53', '8ae8d0bb-2b93-4399-bfe0-4d196bf132b6', 'fecd7f06-49f8-4da8-852d-3dc9889a75b1', '6ed2f976-9f28-4c16-961c-4d1ddebdb627'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a3d4f233-fc59-40f4-b10f-f74862a88ed5 tempest-VolumesGetTest-661166036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a3d4f233-fc59-40f4-b10f-f74862a88ed5 tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a3d4f233-fc59-40f4-b10f-f74862a88ed5 tempest-VolumesGetTest-661166036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a3d4f233-fc59-40f4-b10f-f74862a88ed5 tempest-VolumesGetTest-661166036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a3d4f233-fc59-40f4-b10f-f74862a88ed5 tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3d4f233-fc59-40f4-b10f-f74862a88ed5 tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:41 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:13:41 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:41 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b78fcfc1-5747-4073-a3c5-795722bbce9a tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.d264c76b-7bd8-4792-ac2a-44e69ea8389a" returned: 0 in 0.389s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b78fcfc1-5747-4073-a3c5-795722bbce9a tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:41 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.info Sep 28 17:13:41 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:42 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3d4f233-fc59-40f4-b10f-f74862a88ed5 tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.314s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-a3d4f233-fc59-40f4-b10f-f74862a88ed5 tempest-VolumesGetTest-661166036 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:42 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a3d4f233-fc59-40f4-b10f-f74862a88ed5 tempest-VolumesGetTest-661166036 None] Deleted volume successfully. Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a3d4f233-fc59-40f4-b10f-f74862a88ed5 tempest-VolumesGetTest-661166036 None] Lock "cinder-17f427e6-c11f-4c3a-b105-5bb6642b88f6-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] Acquiring lock "cinder-6bff0055-f7f7-4530-875a-4b8f3c0c497a-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "cinder-6bff0055-f7f7-4530-875a-4b8f3c0c497a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] Acquiring lock "cinder-quobyte-b25fac37-baff-4065-b2b7-d65575303576" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "cinder-quobyte-b25fac37-baff-4065-b2b7-d65575303576" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] Acquiring lock "cinder-quobyte-6bff0055-f7f7-4530-875a-4b8f3c0c497a" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "cinder-quobyte-6bff0055-f7f7-4530-875a-4b8f3c0c497a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] Deleting offline snapshot 6bff0055-f7f7-4530-875a-4b8f3c0c497a of volume b25fac37-baff-4065-b2b7-d65575303576 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] snapshot_file for this snap is: volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a4822f-bd4c-449b-a674-e84df04f6e25]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:42 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b78fcfc1-5747-4073-a3c5-795722bbce9a tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.info" returned: 0 in 0.371s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:42 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-b78fcfc1-5747-4073-a3c5-795722bbce9a tempest-VolumesSnapshotTestJSON-999222795 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.info is being set with open permissions: ugo+rw Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b78fcfc1-5747-4073-a3c5-795722bbce9a tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:42 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.info Sep 28 17:13:42 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:42 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a Sep 28 17:13:42 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:42 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b78fcfc1-5747-4073-a3c5-795722bbce9a tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.info" returned: 0 in 0.343s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b78fcfc1-5747-4073-a3c5-795722bbce9a tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.975s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:42 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:42 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-b78fcfc1-5747-4073-a3c5-795722bbce9a tempest-VolumesSnapshotTestJSON-999222795 None] Create snapshot completed successfully Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a" returned: 0 in 0.512s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b25fac37-baff-4065-b2b7-d65575303576(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b5fbcd-b4ec-430f-8344-b3840a94c07c]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0adad5c4-a510-4bc3-9b46-6145c750ac47 tempest-VolumesGetTest-661166036 None] Acquiring lock "cinder-7ac00b9a-59f7-43ed-b9ca-e775f7d010e8-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0adad5c4-a510-4bc3-9b46-6145c750ac47 tempest-VolumesGetTest-661166036 None] Lock "cinder-7ac00b9a-59f7-43ed-b9ca-e775f7d010e8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0adad5c4-a510-4bc3-9b46-6145c750ac47 tempest-VolumesGetTest-661166036 None] Acquiring lock "cinder-quobyte-7ac00b9a-59f7-43ed-b9ca-e775f7d010e8" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:42 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878 Sep 28 17:13:42 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0adad5c4-a510-4bc3-9b46-6145c750ac47 tempest-VolumesGetTest-661166036 None] Lock "cinder-quobyte-7ac00b9a-59f7-43ed-b9ca-e775f7d010e8" acquired by "delete_volume" :: waited 0.040s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:43 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[0224b046-b3bc-40dc-a7ee-f9cadfb2ae49]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0adad5c4-a510-4bc3-9b46-6145c750ac47 tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ac00b9a-59f7-43ed-b9ca-e775f7d010e8 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:43 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ac00b9a-59f7-43ed-b9ca-e775f7d010e8 Sep 28 17:13:43 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:43 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878" returned: 0 in 0.434s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:43 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b25fac37-baff-4065-b2b7-d65575303576(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:43 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a Sep 28 17:13:43 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:43 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0adad5c4-a510-4bc3-9b46-6145c750ac47 tempest-VolumesGetTest-661166036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ac00b9a-59f7-43ed-b9ca-e775f7d010e8" returned: 0 in 0.495s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0adad5c4-a510-4bc3-9b46-6145c750ac47 tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ac00b9a-59f7-43ed-b9ca-e775f7d010e8 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:43 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ac00b9a-59f7-43ed-b9ca-e775f7d010e8 Sep 28 17:13:43 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:43 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a" returned: 0 in 0.467s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:43 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a Sep 28 17:13:43 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:43 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0adad5c4-a510-4bc3-9b46-6145c750ac47 tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ac00b9a-59f7-43ed-b9ca-e775f7d010e8" returned: 0 in 0.317s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0adad5c4-a510-4bc3-9b46-6145c750ac47 tempest-VolumesGetTest-661166036 None] Lock "cinder-quobyte-7ac00b9a-59f7-43ed-b9ca-e775f7d010e8" released by "delete_volume" :: held 0.871s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:43 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-0adad5c4-a510-4bc3-9b46-6145c750ac47 tempest-VolumesGetTest-661166036 None] Created reservations ['9868937a-9914-41b9-97e3-82d2c2dc1204', '5da34d19-d133-4ced-80ee-82e6a4d447c3', 'f1cf4ebf-e861-43a3-8d9c-f6cc728196c9', 'e907608b-aae7-46c6-9a65-c0e326b08e6d'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0adad5c4-a510-4bc3-9b46-6145c750ac47 tempest-VolumesGetTest-661166036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0adad5c4-a510-4bc3-9b46-6145c750ac47 tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0adad5c4-a510-4bc3-9b46-6145c750ac47 tempest-VolumesGetTest-661166036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0adad5c4-a510-4bc3-9b46-6145c750ac47 tempest-VolumesGetTest-661166036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0adad5c4-a510-4bc3-9b46-6145c750ac47 tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0adad5c4-a510-4bc3-9b46-6145c750ac47 tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:44 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:44 devstack sudo[97316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:13:44 devstack sudo[97316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.6bff0055-f7f7-4530-875a-4b8f3c0c497a" returned: 0 in 0.433s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9b258774-cd80-4406-8abf-0744e6b0d38c tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-d264c76b-7bd8-4792-ac2a-44e69ea8389a-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "cinder-quobyte-6bff0055-f7f7-4530-875a-4b8f3c0c497a" released by "_delete_snapshot" :: held 2.053s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9b258774-cd80-4406-8abf-0744e6b0d38c tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-d264c76b-7bd8-4792-ac2a-44e69ea8389a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "cinder-quobyte-b25fac37-baff-4065-b2b7-d65575303576" released by "delete_snapshot" :: held 2.123s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9b258774-cd80-4406-8abf-0744e6b0d38c tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-quobyte-ebe0034d-55a5-414c-83e6-353e4c101e32" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9b258774-cd80-4406-8abf-0744e6b0d38c tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-ebe0034d-55a5-414c-83e6-353e4c101e32" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9b258774-cd80-4406-8abf-0744e6b0d38c tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-quobyte-d264c76b-7bd8-4792-ac2a-44e69ea8389a" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] Created reservations ['e03d674f-9f6c-4678-86e6-8e0780029c55', 'e5d962ce-8398-4e13-9fa4-cee57258e8f6', '7d9d561d-0f6b-4d58-9921-fcc241c83a36', '519ce49b-91bd-46b7-b6e3-647006c00442'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9b258774-cd80-4406-8abf-0744e6b0d38c tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-d264c76b-7bd8-4792-ac2a-44e69ea8389a" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-9b258774-cd80-4406-8abf-0744e6b0d38c tempest-VolumesSnapshotTestJSON-999222795 None] Deleting offline snapshot d264c76b-7bd8-4792-ac2a-44e69ea8389a of volume ebe0034d-55a5-414c-83e6-353e4c101e32 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-9b258774-cd80-4406-8abf-0744e6b0d38c tempest-VolumesSnapshotTestJSON-999222795 None] snapshot_file for this snap is: volume-ebe0034d-55a5-414c-83e6-353e4c101e32.d264c76b-7bd8-4792-ac2a-44e69ea8389a {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa46501e-e0aa-455a-9417-769ae366d10f]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9b258774-cd80-4406-8abf-0744e6b0d38c tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.d264c76b-7bd8-4792-ac2a-44e69ea8389a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:44 devstack sudo[97316]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0adad5c4-a510-4bc3-9b46-6145c750ac47 tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.482s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-0adad5c4-a510-4bc3-9b46-6145c750ac47 tempest-VolumesGetTest-661166036 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:44 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-0adad5c4-a510-4bc3-9b46-6145c750ac47 tempest-VolumesGetTest-661166036 None] Deleted volume successfully. Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0adad5c4-a510-4bc3-9b46-6145c750ac47 tempest-VolumesGetTest-661166036 None] Lock "cinder-7ac00b9a-59f7-43ed-b9ca-e775f7d010e8-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:44 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] Delete snapshot completed successfully. Sep 28 17:13:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5a2b9793-30ae-4c57-b04c-a5ff7cd032c2 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "cinder-6bff0055-f7f7-4530-875a-4b8f3c0c497a-delete_snapshot" released by "delete_snapshot" :: held 2.561s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:44 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.d264c76b-7bd8-4792-ac2a-44e69ea8389a Sep 28 17:13:44 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Flow 'volume_create_manager' (7c8d1ded-a959-4804-8560-56f66b0114d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:45 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd99b1f8-368e-4124-a31d-45deb516a471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9b258774-cd80-4406-8abf-0744e6b0d38c tempest-VolumesSnapshotTestJSON-999222795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.d264c76b-7bd8-4792-ac2a-44e69ea8389a" returned: 0 in 0.591s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-9b258774-cd80-4406-8abf-0744e6b0d38c tempest-VolumesSnapshotTestJSON-999222795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebe0034d-55a5-414c-83e6-353e4c101e32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd99b1f8-368e-4124-a31d-45deb516a471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1601991469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5449cdd-fdef-40f4-9bdc-7be0498bf2bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47cfc0470734f5a9cf32d38abedcf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:45Z,use_quota=True,user_id='2819d7ed92b34793956b001a87a2f252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27bae90-1397-4b9c-ac74-a869a0606763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27bae90-1397-4b9c-ac74-a869a0606763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb8e927f-6924-48bf-84e5-6f3c936c2e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb8e927f-6924-48bf-84e5-6f3c936c2e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5449cdd-fdef-40f4-9bdc-7be0498bf2bc', 'volume_name': 'volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a79b4b-d8d8-4b8c-af3b-cd245239030e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a79b4b-d8d8-4b8c-af3b-cd245239030e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17481ea2-7bdf-44ea-a80f-bc94e01d1d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:45 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Volume d5449cdd-fdef-40f4-9bdc-7be0498bf2bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc', 'volume_size': 1} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1601991469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5449cdd-fdef-40f4-9bdc-7be0498bf2bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47cfc0470734f5a9cf32d38abedcf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:45Z,use_quota=True,user_id='2819d7ed92b34793956b001a87a2f252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Creating volume d5449cdd-fdef-40f4-9bdc-7be0498bf2bc {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:45 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a71f300-4093-486d-bd1d-1e06b7452765]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9b258774-cd80-4406-8abf-0744e6b0d38c tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:45 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc 1073741824 Sep 28 17:13:45 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:45 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32 Sep 28 17:13:45 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-feb46927-6daa-43e8-9d05-d7d8f98f39d9 tempest-VolumesSnapshotListTestJSON-1854537221 None] Acquiring lock "cinder-3c25f962-ba59-4451-b566-e28d5c779878-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-feb46927-6daa-43e8-9d05-d7d8f98f39d9 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "cinder-3c25f962-ba59-4451-b566-e28d5c779878-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-feb46927-6daa-43e8-9d05-d7d8f98f39d9 tempest-VolumesSnapshotListTestJSON-1854537221 None] Acquiring lock "cinder-quobyte-b25fac37-baff-4065-b2b7-d65575303576" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-feb46927-6daa-43e8-9d05-d7d8f98f39d9 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "cinder-quobyte-b25fac37-baff-4065-b2b7-d65575303576" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-feb46927-6daa-43e8-9d05-d7d8f98f39d9 tempest-VolumesSnapshotListTestJSON-1854537221 None] Acquiring lock "cinder-quobyte-3c25f962-ba59-4451-b566-e28d5c779878" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-feb46927-6daa-43e8-9d05-d7d8f98f39d9 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "cinder-quobyte-3c25f962-ba59-4451-b566-e28d5c779878" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-feb46927-6daa-43e8-9d05-d7d8f98f39d9 tempest-VolumesSnapshotListTestJSON-1854537221 None] Deleting offline snapshot 3c25f962-ba59-4451-b566-e28d5c779878 of volume b25fac37-baff-4065-b2b7-d65575303576 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-feb46927-6daa-43e8-9d05-d7d8f98f39d9 tempest-VolumesSnapshotListTestJSON-1854537221 None] snapshot_file for this snap is: volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[423d0c7e-0904-4ecd-8d3f-34baf4b668a9]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-feb46927-6daa-43e8-9d05-d7d8f98f39d9 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:45 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878 Sep 28 17:13:45 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:45 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9b258774-cd80-4406-8abf-0744e6b0d38c tempest-VolumesSnapshotTestJSON-999222795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32" returned: 0 in 0.720s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9b258774-cd80-4406-8abf-0744e6b0d38c tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.d264c76b-7bd8-4792-ac2a-44e69ea8389a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:45 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.d264c76b-7bd8-4792-ac2a-44e69ea8389a Sep 28 17:13:45 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:46 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc 1073741824" returned: 0 in 0.871s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:46 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc Sep 28 17:13:46 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:46 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-feb46927-6daa-43e8-9d05-d7d8f98f39d9 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878" returned: 0 in 0.607s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-feb46927-6daa-43e8-9d05-d7d8f98f39d9 tempest-VolumesSnapshotListTestJSON-1854537221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b25fac37-baff-4065-b2b7-d65575303576(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:46 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f713f41-1fd1-4bf8-9bf2-5dfba85ffb21]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-feb46927-6daa-43e8-9d05-d7d8f98f39d9 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:46 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576 Sep 28 17:13:46 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:46 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc" returned: 0 in 0.377s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:46 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9b258774-cd80-4406-8abf-0744e6b0d38c tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.d264c76b-7bd8-4792-ac2a-44e69ea8389a" returned: 0 in 0.597s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9b258774-cd80-4406-8abf-0744e6b0d38c tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.d264c76b-7bd8-4792-ac2a-44e69ea8389a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:46 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.d264c76b-7bd8-4792-ac2a-44e69ea8389a Sep 28 17:13:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17481ea2-7bdf-44ea-a80f-bc94e01d1d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:46 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71967765-a2cc-449b-bd65-f01275417387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:46 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Volume volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc (d5449cdd-fdef-40f4-9bdc-7be0498bf2bc): created successfully Sep 28 17:13:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71967765-a2cc-449b-bd65-f01275417387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Flow 'volume_create_manager' (7c8d1ded-a959-4804-8560-56f66b0114d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:46 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-771f1632-b079-45ba-bc5a-de6885af477d tempest-VolumesGetTest-661166036 None] Created volume successfully. Sep 28 17:13:46 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-feb46927-6daa-43e8-9d05-d7d8f98f39d9 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576" returned: 0 in 0.547s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-feb46927-6daa-43e8-9d05-d7d8f98f39d9 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:46 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878 Sep 28 17:13:46 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:46 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9b258774-cd80-4406-8abf-0744e6b0d38c tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32.d264c76b-7bd8-4792-ac2a-44e69ea8389a" returned: 0 in 0.332s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:46 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9b258774-cd80-4406-8abf-0744e6b0d38c tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-d264c76b-7bd8-4792-ac2a-44e69ea8389a" released by "_delete_snapshot" :: held 2.475s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:46 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9b258774-cd80-4406-8abf-0744e6b0d38c tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-ebe0034d-55a5-414c-83e6-353e4c101e32" released by "delete_snapshot" :: held 2.525s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:46 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-9b258774-cd80-4406-8abf-0744e6b0d38c tempest-VolumesSnapshotTestJSON-999222795 None] Created reservations ['c2f5a64c-c5d9-4290-b057-e883e6043c8b', 'c042da2a-cdae-4539-86f8-6904d8cc0317', '5b38ed89-1dbe-41ef-a1f1-650fa8e34691', '56a2ec1c-c5c3-4d36-98cc-6703d44cbb60'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:47 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-9b258774-cd80-4406-8abf-0744e6b0d38c tempest-VolumesSnapshotTestJSON-999222795 None] Delete snapshot completed successfully. Sep 28 17:13:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9b258774-cd80-4406-8abf-0744e6b0d38c tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-d264c76b-7bd8-4792-ac2a-44e69ea8389a-delete_snapshot" released by "delete_snapshot" :: held 2.814s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:47 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-feb46927-6daa-43e8-9d05-d7d8f98f39d9 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878" returned: 0 in 0.461s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-feb46927-6daa-43e8-9d05-d7d8f98f39d9 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:47 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878 Sep 28 17:13:47 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:47 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-feb46927-6daa-43e8-9d05-d7d8f98f39d9 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576.3c25f962-ba59-4451-b566-e28d5c779878" returned: 0 in 0.383s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-feb46927-6daa-43e8-9d05-d7d8f98f39d9 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "cinder-quobyte-3c25f962-ba59-4451-b566-e28d5c779878" released by "_delete_snapshot" :: held 2.266s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-feb46927-6daa-43e8-9d05-d7d8f98f39d9 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "cinder-quobyte-b25fac37-baff-4065-b2b7-d65575303576" released by "delete_snapshot" :: held 2.311s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:47 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-feb46927-6daa-43e8-9d05-d7d8f98f39d9 tempest-VolumesSnapshotListTestJSON-1854537221 None] Created reservations ['22632f4d-369c-4878-bc37-4f7d5db9262b', '0ac53ec0-92c2-4299-a667-2134021e9121', '20125121-42e9-4c43-90bb-91c60d6f8945', '75c66b76-679e-4cca-b5bb-4a8f42d14765'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:47 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-feb46927-6daa-43e8-9d05-d7d8f98f39d9 tempest-VolumesSnapshotListTestJSON-1854537221 None] Delete snapshot completed successfully. Sep 28 17:13:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-feb46927-6daa-43e8-9d05-d7d8f98f39d9 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "cinder-3c25f962-ba59-4451-b566-e28d5c779878-delete_snapshot" released by "delete_snapshot" :: held 2.519s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:47 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Flow 'volume_create_manager' (5caa73fa-6323-43b4-bcd9-bc1112c763ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97e9719-dcaf-4c56-9800-a998b80ef966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97e9719-dcaf-4c56-9800-a998b80ef966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-992287657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=031ca85b-3fef-43eb-b98e-a8dd47ad185a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a47cfc0470734f5a9cf32d38abedcf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d5449cdd-fdef-40f4-9bdc-7be0498bf2bc,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:48Z,use_quota=True,user_id='2819d7ed92b34793956b001a87a2f252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ecd1bb-2fe1-4327-844e-2085dc0ee4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ecd1bb-2fe1-4327-844e-2085dc0ee4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d30e8b-5d96-4fda-b50c-20d65227800a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d30e8b-5d96-4fda-b50c-20d65227800a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '031ca85b-3fef-43eb-b98e-a8dd47ad185a', 'volume_name': 'volume-031ca85b-3fef-43eb-b98e-a8dd47ad185a', 'volume_size': 1, 'source_volid': 'd5449cdd-fdef-40f4-9bdc-7be0498bf2bc', 'source_volstatus': 'available'}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f58c692-865e-42f1-8705-f1b5e88fc28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f58c692-865e-42f1-8705-f1b5e88fc28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee5c7ae-a69f-4736-a52e-89c3a1ff04ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:48 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Volume 031ca85b-3fef-43eb-b98e-a8dd47ad185a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-031ca85b-3fef-43eb-b98e-a8dd47ad185a', 'volume_size': 1, 'source_volid': 'd5449cdd-fdef-40f4-9bdc-7be0498bf2bc', 'source_volstatus': 'available'} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:48 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Cloning volume d5449cdd-fdef-40f4-9bdc-7be0498bf2bc to volume 031ca85b-3fef-43eb-b98e-a8dd47ad185a Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Creating offline snapshot 71dcf16a-fff7-4205-a3a6-1684e2201643 of volume d5449cdd-fdef-40f4-9bdc-7be0498bf2bc {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0472a54-c23c-4b1e-b800-ec87a4e67e5b]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:48 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc Sep 28 17:13:48 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Flow 'volume_create_manager' (0d063165-9884-4dbc-b694-91e0682e198b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6a1e40-aa80-4ae8-b3f4-88b928f87634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6a1e40-aa80-4ae8-b3f4-88b928f87634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-700199729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab2b42f-440e-4553-982c-3cee43f355a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1597d278c62544538f0172cd1292f3dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:48Z,use_quota=True,user_id='e598fcac75cb44488aca25b98e029a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abec6ecd-6bb9-4cab-9fa7-ffe7abe9f0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abec6ecd-6bb9-4cab-9fa7-ffe7abe9f0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c888701-46e5-445e-8920-7f47a8f441f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c888701-46e5-445e-8920-7f47a8f441f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ab2b42f-440e-4553-982c-3cee43f355a1', 'volume_name': 'volume-5ab2b42f-440e-4553-982c-3cee43f355a1', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c643157c-03e4-49fd-8eb6-b9c4b3b74697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c643157c-03e4-49fd-8eb6-b9c4b3b74697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1490142f-df50-446a-aad8-df4e1dff254e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:48 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Volume 5ab2b42f-440e-4553-982c-3cee43f355a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ab2b42f-440e-4553-982c-3cee43f355a1', 'volume_size': 1} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:48 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc" returned: 0 in 0.467s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:48 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643 1G Sep 28 17:13:48 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ee7f4da7-c538-4ee1-bc9a-8a799d889707 tempest-VolumesSnapshotListTestJSON-1854537221 None] Acquiring lock "cinder-b25fac37-baff-4065-b2b7-d65575303576-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ee7f4da7-c538-4ee1-bc9a-8a799d889707 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "cinder-b25fac37-baff-4065-b2b7-d65575303576-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ee7f4da7-c538-4ee1-bc9a-8a799d889707 tempest-VolumesSnapshotListTestJSON-1854537221 None] Acquiring lock "cinder-quobyte-b25fac37-baff-4065-b2b7-d65575303576" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ee7f4da7-c538-4ee1-bc9a-8a799d889707 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "cinder-quobyte-b25fac37-baff-4065-b2b7-d65575303576" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9220fd09-6325-4af4-b13b-89f0432011ab]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ee7f4da7-c538-4ee1-bc9a-8a799d889707 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:49 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576 Sep 28 17:13:49 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:49 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643 1G" returned: 0 in 0.517s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:49 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643 Sep 28 17:13:49 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:49 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ee7f4da7-c538-4ee1-bc9a-8a799d889707 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576" returned: 0 in 0.460s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ee7f4da7-c538-4ee1-bc9a-8a799d889707 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:49 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576 Sep 28 17:13:49 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:49 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643" returned: 0 in 0.358s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:49 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643 is being set with open permissions: ugo+rw Sep 28 17:13:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:49 devstack sudo[97416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643 Sep 28 17:13:49 devstack sudo[97416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:49 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ee7f4da7-c538-4ee1-bc9a-8a799d889707 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b25fac37-baff-4065-b2b7-d65575303576" returned: 0 in 0.310s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:49 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ee7f4da7-c538-4ee1-bc9a-8a799d889707 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "cinder-quobyte-b25fac37-baff-4065-b2b7-d65575303576" released by "delete_volume" :: held 0.855s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:49 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-ee7f4da7-c538-4ee1-bc9a-8a799d889707 tempest-VolumesSnapshotListTestJSON-1854537221 None] Created reservations ['4e1ed981-b067-491a-8d95-1749a3fdf411', 'a716669c-f1e6-49a5-bca7-38eb99b9614e', '62a831b6-2b1e-4a07-a7c6-4dc3e83b1f31', 'cb566b4c-7b87-4447-920d-5eaee4644fca'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:49 devstack sudo[97416]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643" returned: 0 in 0.304s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:49 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.info Sep 28 17:13:49 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ee7f4da7-c538-4ee1-bc9a-8a799d889707 tempest-VolumesSnapshotListTestJSON-1854537221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ee7f4da7-c538-4ee1-bc9a-8a799d889707 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:49 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f4da7-c538-4ee1-bc9a-8a799d889707 tempest-VolumesSnapshotListTestJSON-1854537221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:49 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f4da7-c538-4ee1-bc9a-8a799d889707 tempest-VolumesSnapshotListTestJSON-1854537221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ee7f4da7-c538-4ee1-bc9a-8a799d889707 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ee7f4da7-c538-4ee1-bc9a-8a799d889707 tempest-VolumesSnapshotListTestJSON-1854537221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:49 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:13:49 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:50 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.info" returned: 0 in 0.360s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:50 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.info is being set with open permissions: ugo+rw Sep 28 17:13:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:50 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ee7f4da7-c538-4ee1-bc9a-8a799d889707 tempest-VolumesSnapshotListTestJSON-1854537221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.315s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:50 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-ee7f4da7-c538-4ee1-bc9a-8a799d889707 tempest-VolumesSnapshotListTestJSON-1854537221 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:50 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.info Sep 28 17:13:50 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:50 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-ee7f4da7-c538-4ee1-bc9a-8a799d889707 tempest-VolumesSnapshotListTestJSON-1854537221 None] Deleted volume successfully. Sep 28 17:13:50 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ee7f4da7-c538-4ee1-bc9a-8a799d889707 tempest-VolumesSnapshotListTestJSON-1854537221 None] Lock "cinder-b25fac37-baff-4065-b2b7-d65575303576-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:50 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.info" returned: 0 in 0.322s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:50 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Acquiring lock "cinder-quobyte-031ca85b-3fef-43eb-b98e-a8dd47ad185a" by "_copy_volume_from_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:50 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Lock "cinder-quobyte-031ca85b-3fef-43eb-b98e-a8dd47ad185a" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:50 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] snapshot: 71dcf16a-fff7-4205-a3a6-1684e2201643, volume: 031ca85b-3fef-43eb-b98e-a8dd47ad185a, {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:13:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:50 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:50 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:50 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ccf82a-bdbb-4c28-97e7-08141a9ee259]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:50 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643 Sep 28 17:13:50 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:51 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643" returned: 0 in 0.507s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:51 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a52ebf-1639-4dab-a8c6-45d1f180d4ce]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:51 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc Sep 28 17:13:51 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:51 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc" returned: 0 in 0.496s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:13:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Creating direct copy from snapshot {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:13:51 devstack cinder-volume[87061]: DEBUG cinder.utils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Path /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-031ca85b-3fef-43eb-b98e-a8dd47ad185a not found in is_blk_device check {{(pid=87061) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:13:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-031ca85b-3fef-43eb-b98e-a8dd47ad185a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:51 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-031ca85b-3fef-43eb-b98e-a8dd47ad185a Sep 28 17:13:51 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:55 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Flow 'volume_create_manager' (4ce5cdde-0084-44bb-b3a7-0a3a538be6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6825b46f-9679-425c-9993-21b355c206c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6825b46f-9679-425c-9993-21b355c206c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1507721411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956bf41a-7497-4279-8077-39facf65c5f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33cc50b4ca8c4eda935840682a481072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:56Z,use_quota=True,user_id='038b0a628a1c439787e03e97002bb1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf32815-5087-4c19-b61a-9e357b26621a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf32815-5087-4c19-b61a-9e357b26621a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d4217c-4bc3-4328-8917-9b337ef2ded3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d4217c-4bc3-4328-8917-9b337ef2ded3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '956bf41a-7497-4279-8077-39facf65c5f3', 'volume_name': 'volume-956bf41a-7497-4279-8077-39facf65c5f3', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1537a8cb-6696-4e7b-83bc-9ef5c051c2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1537a8cb-6696-4e7b-83bc-9ef5c051c2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e292b8bd-7a6b-419b-9652-5a0911513ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:56 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Volume 956bf41a-7497-4279-8077-39facf65c5f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-956bf41a-7497-4279-8077-39facf65c5f3', 'volume_size': 1} Sep 28 17:13:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:57 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Flow 'volume_create_manager' (ebf8e46d-fb9b-4e85-ac9f-3515e9519e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d053eb-4274-46ab-b64e-d67c388dc4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d053eb-4274-46ab-b64e-d67c388dc4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1337568106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ac12a1-8fcc-4330-abf7-219f2fc5dbeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='231130faf28c40e7bf079851c5b01fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:57Z,use_quota=True,user_id='26950c66128241f9ad7e87131160c4e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8efb90d9-d6d6-4e68-9dc8-4d2e6feffeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8efb90d9-d6d6-4e68-9dc8-4d2e6feffeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5aa771d-b2a9-4dd0-b317-72bb1a74d4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5aa771d-b2a9-4dd0-b317-72bb1a74d4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40ac12a1-8fcc-4330-abf7-219f2fc5dbeb', 'volume_name': 'volume-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8196256a-060d-4020-91e5-2bbf03fb0a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8196256a-060d-4020-91e5-2bbf03fb0a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dff54d8-b013-4175-9a76-fd01335cccde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:57 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Volume 40ac12a1-8fcc-4330-abf7-219f2fc5dbeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb', 'volume_size': 1} Sep 28 17:13:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:57 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Flow 'volume_create_manager' (14386335-a60e-4173-89e3-e3e3c909bcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aaa850b-0751-45e6-9beb-bc4b853a2dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aaa850b-0751-45e6-9beb-bc4b853a2dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1316492561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1ebeec-2771-4844-b35b-3491918c984d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33cc50b4ca8c4eda935840682a481072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:57Z,use_quota=True,user_id='038b0a628a1c439787e03e97002bb1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572207fb-8a53-40ce-a48b-54e46ca9b5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572207fb-8a53-40ce-a48b-54e46ca9b5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc56b85e-c670-470a-93e6-f8db0a1ac22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc56b85e-c670-470a-93e6-f8db0a1ac22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae1ebeec-2771-4844-b35b-3491918c984d', 'volume_name': 'volume-ae1ebeec-2771-4844-b35b-3491918c984d', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c63ad54-f34b-4b48-9637-012acb2cba90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c63ad54-f34b-4b48-9637-012acb2cba90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7685ea8-d0aa-4604-a19c-bb710d407d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:58 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Volume ae1ebeec-2771-4844-b35b-3491918c984d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae1ebeec-2771-4844-b35b-3491918c984d', 'volume_size': 1} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Flow 'volume_create_manager' (f1533e09-ca40-420f-9be7-0bdafbd1b909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47bd7b24-bf4b-40f5-b618-70ffe3ac0ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47bd7b24-bf4b-40f5-b618-70ffe3ac0ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1941803554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7800e94-8b1d-415e-a484-f7897a14790b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33cc50b4ca8c4eda935840682a481072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:58Z,use_quota=True,user_id='038b0a628a1c439787e03e97002bb1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2aaf327-32bd-421a-9664-70ff4a458a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2aaf327-32bd-421a-9664-70ff4a458a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d65f638-6e0d-499a-a8e8-61257373db6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d65f638-6e0d-499a-a8e8-61257373db6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7800e94-8b1d-415e-a484-f7897a14790b', 'volume_name': 'volume-b7800e94-8b1d-415e-a484-f7897a14790b', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c05b6a-8062-4bdc-8409-9bc699527a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c05b6a-8062-4bdc-8409-9bc699527a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97994ad-712b-42b6-ace6-bc957d13594e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:58 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Volume b7800e94-8b1d-415e-a484-f7897a14790b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7800e94-8b1d-415e-a484-f7897a14790b', 'volume_size': 1} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Flow 'volume_create_manager' (076f3f77-3cea-4c7b-b415-29585d88874c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7887b8f-56a1-4e25-b19b-89489d53a28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7887b8f-56a1-4e25-b19b-89489d53a28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-212375356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce821c5b-465e-475b-aa03-ca549155d239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33cc50b4ca8c4eda935840682a481072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:58Z,use_quota=True,user_id='038b0a628a1c439787e03e97002bb1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5750811a-3a36-4517-9aad-c366807a541a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5750811a-3a36-4517-9aad-c366807a541a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4368c1a4-afcf-47ce-8daf-bcdead0dca20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4368c1a4-afcf-47ce-8daf-bcdead0dca20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce821c5b-465e-475b-aa03-ca549155d239', 'volume_name': 'volume-ce821c5b-465e-475b-aa03-ca549155d239', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a29c674e-fdfc-445e-bbb7-f72af164add0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a29c674e-fdfc-445e-bbb7-f72af164add0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94c6524-fc4a-4607-b785-e9035f392b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:58 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Volume ce821c5b-465e-475b-aa03-ca549155d239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce821c5b-465e-475b-aa03-ca549155d239', 'volume_size': 1} Sep 28 17:13:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:59 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Flow 'volume_create_manager' (69691c8e-9929-45b6-8e04-a6d0828209b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd41d32-7ef9-4ded-88ad-8afc223f1fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd41d32-7ef9-4ded-88ad-8afc223f1fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-344435942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43107586-e0e1-49d8-85b1-00d6e3a92029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33cc50b4ca8c4eda935840682a481072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:59Z,use_quota=True,user_id='038b0a628a1c439787e03e97002bb1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272a9e7a-23df-49ee-bb53-81ece57f2fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272a9e7a-23df-49ee-bb53-81ece57f2fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fdf16ff-e8ed-47a7-998f-6eb3d4011292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fdf16ff-e8ed-47a7-998f-6eb3d4011292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43107586-e0e1-49d8-85b1-00d6e3a92029', 'volume_name': 'volume-43107586-e0e1-49d8-85b1-00d6e3a92029', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627e53c0-4cb9-409d-948a-052d4590c1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627e53c0-4cb9-409d-948a-052d4590c1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7491e7-d860-41ca-b53a-a7e927007f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:59 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Volume 43107586-e0e1-49d8-85b1-00d6e3a92029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43107586-e0e1-49d8-85b1-00d6e3a92029', 'volume_size': 1} Sep 28 17:13:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:00 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-031ca85b-3fef-43eb-b98e-a8dd47ad185a" returned: 0 in 9.056s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:00 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Image conversion details: src /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc, size 1024.00 MB, duration 9.06 sec, destination /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-031ca85b-3fef-43eb-b98e-a8dd47ad185a {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:14:00 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Converted 1024.00 MB image at 113.06 MB/s Sep 28 17:14:00 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-031ca85b-3fef-43eb-b98e-a8dd47ad185a is being set with open permissions: ugo+rw Sep 28 17:14:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-031ca85b-3fef-43eb-b98e-a8dd47ad185a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:00 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-031ca85b-3fef-43eb-b98e-a8dd47ad185a Sep 28 17:14:00 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:00 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-031ca85b-3fef-43eb-b98e-a8dd47ad185a" returned: 0 in 0.260s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Lock "cinder-quobyte-031ca85b-3fef-43eb-b98e-a8dd47ad185a" released by "_copy_volume_from_snapshot" :: held 10.420s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:01 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Acquiring lock "cinder-quobyte-71dcf16a-fff7-4205-a3a6-1684e2201643" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:01 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Lock "cinder-quobyte-71dcf16a-fff7-4205-a3a6-1684e2201643" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Deleting offline snapshot 71dcf16a-fff7-4205-a3a6-1684e2201643 of volume d5449cdd-fdef-40f4-9bdc-7be0498bf2bc {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:14:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] snapshot_file for this snap is: volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:14:01 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47d0a12-e227-429f-9f19-da23d683b122]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:01 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643 Sep 28 17:14:01 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:01 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643" returned: 0 in 0.404s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:01 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[41963770-0eca-4e24-be63-7aa90b413306]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:01 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc Sep 28 17:14:01 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:02 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc" returned: 0 in 0.562s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:02 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643 Sep 28 17:14:02 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:02 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643" returned: 0 in 0.399s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:02 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643 Sep 28 17:14:02 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:02 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc.71dcf16a-fff7-4205-a3a6-1684e2201643" returned: 0 in 0.281s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:02 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Lock "cinder-quobyte-71dcf16a-fff7-4205-a3a6-1684e2201643" released by "_delete_snapshot" :: held 1.767s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.784s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.346s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-700199729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab2b42f-440e-4553-982c-3cee43f355a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1597d278c62544538f0172cd1292f3dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:48Z,use_quota=True,user_id='e598fcac75cb44488aca25b98e029a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Creating volume 5ab2b42f-440e-4553-982c-3cee43f355a1 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:02 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:14:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:02 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1 1073741824 Sep 28 17:14:02 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee5c7ae-a69f-4736-a52e-89c3a1ff04ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-031ca85b-3fef-43eb-b98e-a8dd47ad185a', 'volume_size': 1, 'source_volid': 'd5449cdd-fdef-40f4-9bdc-7be0498bf2bc', 'source_volstatus': 'available'}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa753df-09b6-4265-ab2e-14a45fbd0cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:02 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Volume volume-031ca85b-3fef-43eb-b98e-a8dd47ad185a (031ca85b-3fef-43eb-b98e-a8dd47ad185a): created successfully Sep 28 17:14:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa753df-09b6-4265-ab2e-14a45fbd0cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Flow 'volume_create_manager' (5caa73fa-6323-43b4-bcd9-bc1112c763ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:02 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-932c3a05-9ed0-49d5-9118-138fc0cae5ff tempest-VolumesGetTest-661166036 None] Created volume successfully. Sep 28 17:14:03 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1 1073741824" returned: 0 in 0.569s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:03 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1 Sep 28 17:14:03 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:03 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1" returned: 0 in 0.315s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.690s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1507721411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956bf41a-7497-4279-8077-39facf65c5f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33cc50b4ca8c4eda935840682a481072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:56Z,use_quota=True,user_id='038b0a628a1c439787e03e97002bb1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Creating volume 956bf41a-7497-4279-8077-39facf65c5f3 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:03 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:14:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-956bf41a-7497-4279-8077-39facf65c5f3 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1490142f-df50-446a-aad8-df4e1dff254e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ab2b42f-440e-4553-982c-3cee43f355a1', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:03 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-956bf41a-7497-4279-8077-39facf65c5f3 1073741824 Sep 28 17:14:03 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929e3433-f696-487d-8af4-5fd6a25f24b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:03 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Volume volume-5ab2b42f-440e-4553-982c-3cee43f355a1 (5ab2b42f-440e-4553-982c-3cee43f355a1): created successfully Sep 28 17:14:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929e3433-f696-487d-8af4-5fd6a25f24b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Flow 'volume_create_manager' (0d063165-9884-4dbc-b694-91e0682e198b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:03 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d495c407-8bd0-4af9-8d9c-483cdc52b303 tempest-VolumesSnapshotTestJSON-999222795 None] Created volume successfully. Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Flow 'volume_create_manager' (f2f78ce2-aa7a-41c3-aa92-875e6042e13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (872eb4f5-0a84-483c-8d0f-05457b912674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (872eb4f5-0a84-483c-8d0f-05457b912674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1332572691',display_name='tempest-VolumesGetTest-Volume-1670864009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58afb522-dfcf-4746-8086-718c4112adb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47cfc0470734f5a9cf32d38abedcf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:04Z,use_quota=True,user_id='2819d7ed92b34793956b001a87a2f252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:04 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d532b478-ab5a-422e-99f5-52e10362c2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d532b478-ab5a-422e-99f5-52e10362c2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90899899-f5de-4b42-88be-75e60529c7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90899899-f5de-4b42-88be-75e60529c7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58afb522-dfcf-4746-8086-718c4112adb2', 'volume_name': 'volume-58afb522-dfcf-4746-8086-718c4112adb2', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f682b89-4792-4734-83a7-e78dd506f08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f682b89-4792-4734-83a7-e78dd506f08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffed8a8a-e9b7-45a4-9d16-c5913d31406b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:04 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Volume 58afb522-dfcf-4746-8086-718c4112adb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58afb522-dfcf-4746-8086-718c4112adb2', 'volume_size': 1} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-956bf41a-7497-4279-8077-39facf65c5f3 1073741824" returned: 0 in 0.654s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-956bf41a-7497-4279-8077-39facf65c5f3 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:04 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-956bf41a-7497-4279-8077-39facf65c5f3 Sep 28 17:14:04 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a223e8e9-baf6-4efa-9906-bf905755573e tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:04 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-956bf41a-7497-4279-8077-39facf65c5f3" returned: 0 in 0.373s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.187s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1337568106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ac12a1-8fcc-4330-abf7-219f2fc5dbeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='231130faf28c40e7bf079851c5b01fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:57Z,use_quota=True,user_id='26950c66128241f9ad7e87131160c4e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Creating volume 40ac12a1-8fcc-4330-abf7-219f2fc5dbeb {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:04 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:04 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb 1073741824 Sep 28 17:14:04 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e292b8bd-7a6b-419b-9652-5a0911513ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-956bf41a-7497-4279-8077-39facf65c5f3', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c81695e-4853-45d5-8bbd-6d9d7b501cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:04 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Volume volume-956bf41a-7497-4279-8077-39facf65c5f3 (956bf41a-7497-4279-8077-39facf65c5f3): created successfully Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c81695e-4853-45d5-8bbd-6d9d7b501cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Flow 'volume_create_manager' (4ce5cdde-0084-44bb-b3a7-0a3a538be6a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:05 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a6c17f06-06ea-4a88-b88d-19ceb24b071b tempest-CreateVolumesFromImageTest-1521462606 None] Created volume successfully. Sep 28 17:14:05 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb 1073741824" returned: 0 in 0.491s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:05 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb Sep 28 17:14:05 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:05 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb" returned: 0 in 0.302s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.728s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1316492561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1ebeec-2771-4844-b35b-3491918c984d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33cc50b4ca8c4eda935840682a481072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:57Z,use_quota=True,user_id='038b0a628a1c439787e03e97002bb1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Creating volume ae1ebeec-2771-4844-b35b-3491918c984d {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:05 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:14:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae1ebeec-2771-4844-b35b-3491918c984d 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dff54d8-b013-4175-9a76-fd01335cccde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:05 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae1ebeec-2771-4844-b35b-3491918c984d 1073741824 Sep 28 17:14:05 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4904e62-9fc2-4c09-b888-33850eedc4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:05 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Volume volume-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb (40ac12a1-8fcc-4330-abf7-219f2fc5dbeb): created successfully Sep 28 17:14:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4904e62-9fc2-4c09-b888-33850eedc4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Flow 'volume_create_manager' (ebf8e46d-fb9b-4e85-ac9f-3515e9519e0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:05 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-8a04cefc-7183-41dd-87e5-88b08fa0675c tempest-AttachVolumeTestJSON-1078994482 None] Created volume successfully. Sep 28 17:14:06 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae1ebeec-2771-4844-b35b-3491918c984d 1073741824" returned: 0 in 0.613s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae1ebeec-2771-4844-b35b-3491918c984d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:06 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae1ebeec-2771-4844-b35b-3491918c984d Sep 28 17:14:06 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:06 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae1ebeec-2771-4844-b35b-3491918c984d" returned: 0 in 0.290s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.451s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1941803554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7800e94-8b1d-415e-a484-f7897a14790b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33cc50b4ca8c4eda935840682a481072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:58Z,use_quota=True,user_id='038b0a628a1c439787e03e97002bb1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Creating volume b7800e94-8b1d-415e-a484-f7897a14790b {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:06 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b7800e94-8b1d-415e-a484-f7897a14790b 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:06 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b7800e94-8b1d-415e-a484-f7897a14790b 1073741824 Sep 28 17:14:06 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7685ea8-d0aa-4604-a19c-bb710d407d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae1ebeec-2771-4844-b35b-3491918c984d', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7b04c3-9580-43be-9e0e-2f772e6b43f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:06 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:14:06 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:06 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Volume volume-ae1ebeec-2771-4844-b35b-3491918c984d (ae1ebeec-2771-4844-b35b-3491918c984d): created successfully Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7b04c3-9580-43be-9e0e-2f772e6b43f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Flow 'volume_create_manager' (14386335-a60e-4173-89e3-e3e3c909bcd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:06 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-b0c30f21-6066-4149-ab68-577008607622 tempest-CreateVolumesFromImageTest-1521462606 None] Created volume successfully. Sep 28 17:14:07 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.374s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:14:07 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b7800e94-8b1d-415e-a484-f7897a14790b 1073741824" returned: 0 in 0.698s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b7800e94-8b1d-415e-a484-f7897a14790b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:07 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b7800e94-8b1d-415e-a484-f7897a14790b Sep 28 17:14:07 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-8f2359b3-d22b-4fe0-8de5-c1722a878552 req-dc045d88-a8fb-48de-b074-a10313f6f240 tempest-AttachVolumeTestJSON-1078994482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:07 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b7800e94-8b1d-415e-a484-f7897a14790b" returned: 0 in 0.322s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.980s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-212375356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce821c5b-465e-475b-aa03-ca549155d239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33cc50b4ca8c4eda935840682a481072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:58Z,use_quota=True,user_id='038b0a628a1c439787e03e97002bb1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Creating volume ce821c5b-465e-475b-aa03-ca549155d239 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:07 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce821c5b-465e-475b-aa03-ca549155d239 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:07 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce821c5b-465e-475b-aa03-ca549155d239 1073741824 Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97994ad-712b-42b6-ace6-bc957d13594e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7800e94-8b1d-415e-a484-f7897a14790b', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:07 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707b3ecd-a2b2-4837-98b1-96791e2df803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:07 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Volume volume-b7800e94-8b1d-415e-a484-f7897a14790b (b7800e94-8b1d-415e-a484-f7897a14790b): created successfully Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707b3ecd-a2b2-4837-98b1-96791e2df803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Flow 'volume_create_manager' (f1533e09-ca40-420f-9be7-0bdafbd1b909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:07 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-07179019-341e-4a2d-b5ad-2c6b09c229db tempest-CreateVolumesFromImageTest-1521462606 None] Created volume successfully. Sep 28 17:14:08 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce821c5b-465e-475b-aa03-ca549155d239 1073741824" returned: 0 in 0.555s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce821c5b-465e-475b-aa03-ca549155d239 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:08 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce821c5b-465e-475b-aa03-ca549155d239 Sep 28 17:14:08 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:08 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce821c5b-465e-475b-aa03-ca549155d239" returned: 0 in 0.296s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.181s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-344435942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43107586-e0e1-49d8-85b1-00d6e3a92029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33cc50b4ca8c4eda935840682a481072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:59Z,use_quota=True,user_id='038b0a628a1c439787e03e97002bb1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Creating volume 43107586-e0e1-49d8-85b1-00d6e3a92029 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:08 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:14:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-43107586-e0e1-49d8-85b1-00d6e3a92029 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:08 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-43107586-e0e1-49d8-85b1-00d6e3a92029 1073741824 Sep 28 17:14:08 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94c6524-fc4a-4607-b785-e9035f392b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce821c5b-465e-475b-aa03-ca549155d239', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f947dd-bbc5-4137-b76a-87b805e24917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:08 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Volume volume-ce821c5b-465e-475b-aa03-ca549155d239 (ce821c5b-465e-475b-aa03-ca549155d239): created successfully Sep 28 17:14:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f947dd-bbc5-4137-b76a-87b805e24917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Flow 'volume_create_manager' (076f3f77-3cea-4c7b-b415-29585d88874c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:08 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-382971fb-18a2-476b-957d-17c00012f35a tempest-CreateVolumesFromImageTest-1521462606 None] Created volume successfully. Sep 28 17:14:09 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-43107586-e0e1-49d8-85b1-00d6e3a92029 1073741824" returned: 0 in 0.491s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-43107586-e0e1-49d8-85b1-00d6e3a92029 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:09 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-43107586-e0e1-49d8-85b1-00d6e3a92029 Sep 28 17:14:09 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:09 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-43107586-e0e1-49d8-85b1-00d6e3a92029" returned: 0 in 0.269s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.062s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1332572691',display_name='tempest-VolumesGetTest-Volume-1670864009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58afb522-dfcf-4746-8086-718c4112adb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47cfc0470734f5a9cf32d38abedcf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:04Z,use_quota=True,user_id='2819d7ed92b34793956b001a87a2f252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Creating volume 58afb522-dfcf-4746-8086-718c4112adb2 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:09 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:14:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58afb522-dfcf-4746-8086-718c4112adb2 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:09 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58afb522-dfcf-4746-8086-718c4112adb2 1073741824 Sep 28 17:14:09 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7491e7-d860-41ca-b53a-a7e927007f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43107586-e0e1-49d8-85b1-00d6e3a92029', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1f32272-0327-4d1b-82eb-6aa7dbdd7b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:09 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Volume volume-43107586-e0e1-49d8-85b1-00d6e3a92029 (43107586-e0e1-49d8-85b1-00d6e3a92029): created successfully Sep 28 17:14:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1f32272-0327-4d1b-82eb-6aa7dbdd7b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Flow 'volume_create_manager' (69691c8e-9929-45b6-8e04-a6d0828209b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:09 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-b69ce63a-5805-440c-ba17-13e6711a64a0 tempest-CreateVolumesFromImageTest-1521462606 None] Created volume successfully. Sep 28 17:14:10 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58afb522-dfcf-4746-8086-718c4112adb2 1073741824" returned: 0 in 0.497s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58afb522-dfcf-4746-8086-718c4112adb2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:10 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58afb522-dfcf-4746-8086-718c4112adb2 Sep 28 17:14:10 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:10 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58afb522-dfcf-4746-8086-718c4112adb2" returned: 0 in 0.273s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a223e8e9-baf6-4efa-9906-bf905755573e tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.598s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffed8a8a-e9b7-45a4-9d16-c5913d31406b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58afb522-dfcf-4746-8086-718c4112adb2', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ad49ee-bf5b-4132-9f85-75dd8716a2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-a223e8e9-baf6-4efa-9906-bf905755573e tempest-VolumesSnapshotTestJSON-999222795 None] Creating offline snapshot b0775792-1d96-4a1b-b4f4-c55b8965b2ee of volume 5ab2b42f-440e-4553-982c-3cee43f355a1 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:14:10 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Volume volume-58afb522-dfcf-4746-8086-718c4112adb2 (58afb522-dfcf-4746-8086-718c4112adb2): created successfully Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ad49ee-bf5b-4132-9f85-75dd8716a2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Flow 'volume_create_manager' (f2f78ce2-aa7a-41c3-aa92-875e6042e13f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d320fa-13a1-45c2-916b-b12bf69e8879]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ba34e073-7cfa-4fa9-ac37-02c32b2ced3b tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "cinder-43107586-e0e1-49d8-85b1-00d6e3a92029-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a223e8e9-baf6-4efa-9906-bf905755573e tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:10 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-cf69fc99-74c3-45ef-a1ec-fd0f63a8cac9 tempest-VolumesGetTest-661166036 None] Created volume successfully. Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ba34e073-7cfa-4fa9-ac37-02c32b2ced3b tempest-CreateVolumesFromImageTest-1521462606 None] Lock "cinder-43107586-e0e1-49d8-85b1-00d6e3a92029-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ba34e073-7cfa-4fa9-ac37-02c32b2ced3b tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "cinder-quobyte-43107586-e0e1-49d8-85b1-00d6e3a92029" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ba34e073-7cfa-4fa9-ac37-02c32b2ced3b tempest-CreateVolumesFromImageTest-1521462606 None] Lock "cinder-quobyte-43107586-e0e1-49d8-85b1-00d6e3a92029" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bba78f1-1195-412f-99b4-046d246092bf]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ba34e073-7cfa-4fa9-ac37-02c32b2ced3b tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-43107586-e0e1-49d8-85b1-00d6e3a92029 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:10 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1 Sep 28 17:14:10 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:10 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-43107586-e0e1-49d8-85b1-00d6e3a92029 Sep 28 17:14:10 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:10 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9d3714d6-d7bd-4abb-a060-937b103f2178 tempest-VolumesGetTest-661166036 None] Acquiring lock "cinder-58afb522-dfcf-4746-8086-718c4112adb2-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a223e8e9-baf6-4efa-9906-bf905755573e tempest-VolumesSnapshotTestJSON-999222795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1" returned: 0 in 0.489s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a223e8e9-baf6-4efa-9906-bf905755573e tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9d3714d6-d7bd-4abb-a060-937b103f2178 tempest-VolumesGetTest-661166036 None] Lock "cinder-58afb522-dfcf-4746-8086-718c4112adb2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:10 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee 1G Sep 28 17:14:10 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9d3714d6-d7bd-4abb-a060-937b103f2178 tempest-VolumesGetTest-661166036 None] Acquiring lock "cinder-quobyte-58afb522-dfcf-4746-8086-718c4112adb2" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9d3714d6-d7bd-4abb-a060-937b103f2178 tempest-VolumesGetTest-661166036 None] Lock "cinder-quobyte-58afb522-dfcf-4746-8086-718c4112adb2" acquired by "delete_volume" :: waited 0.027s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40fea87-b17e-4ea9-93a5-d518c5681e3b]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9d3714d6-d7bd-4abb-a060-937b103f2178 tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58afb522-dfcf-4746-8086-718c4112adb2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:11 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ba34e073-7cfa-4fa9-ac37-02c32b2ced3b tempest-CreateVolumesFromImageTest-1521462606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-43107586-e0e1-49d8-85b1-00d6e3a92029" returned: 0 in 0.534s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ba34e073-7cfa-4fa9-ac37-02c32b2ced3b tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-43107586-e0e1-49d8-85b1-00d6e3a92029 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:11 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-43107586-e0e1-49d8-85b1-00d6e3a92029 Sep 28 17:14:11 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:11 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58afb522-dfcf-4746-8086-718c4112adb2 Sep 28 17:14:11 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:11 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ba34e073-7cfa-4fa9-ac37-02c32b2ced3b tempest-CreateVolumesFromImageTest-1521462606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-43107586-e0e1-49d8-85b1-00d6e3a92029" returned: 0 in 0.306s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ba34e073-7cfa-4fa9-ac37-02c32b2ced3b tempest-CreateVolumesFromImageTest-1521462606 None] Lock "cinder-quobyte-43107586-e0e1-49d8-85b1-00d6e3a92029" released by "delete_volume" :: held 0.901s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:11 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a223e8e9-baf6-4efa-9906-bf905755573e tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee 1G" returned: 0 in 0.532s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a223e8e9-baf6-4efa-9906-bf905755573e tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ab2b42f-440e-4553-982c-3cee43f355a1 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:11 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ab2b42f-440e-4553-982c-3cee43f355a1 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee Sep 28 17:14:11 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-ba34e073-7cfa-4fa9-ac37-02c32b2ced3b tempest-CreateVolumesFromImageTest-1521462606 None] Created reservations ['d8ba03b5-5343-4add-b4bc-608785b02a55', '845c3e18-62b3-4c7e-a5e7-d74e8f93eba5', '20c7eae1-5eb8-4cce-b067-11c26afc3fda', '3702dec9-2944-41db-bf09-e78a4ce834c9'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:11 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9d3714d6-d7bd-4abb-a060-937b103f2178 tempest-VolumesGetTest-661166036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58afb522-dfcf-4746-8086-718c4112adb2" returned: 0 in 0.502s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9d3714d6-d7bd-4abb-a060-937b103f2178 tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58afb522-dfcf-4746-8086-718c4112adb2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:11 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58afb522-dfcf-4746-8086-718c4112adb2 Sep 28 17:14:11 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ba34e073-7cfa-4fa9-ac37-02c32b2ced3b tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ba34e073-7cfa-4fa9-ac37-02c32b2ced3b tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ba34e073-7cfa-4fa9-ac37-02c32b2ced3b tempest-CreateVolumesFromImageTest-1521462606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ba34e073-7cfa-4fa9-ac37-02c32b2ced3b tempest-CreateVolumesFromImageTest-1521462606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ba34e073-7cfa-4fa9-ac37-02c32b2ced3b tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ba34e073-7cfa-4fa9-ac37-02c32b2ced3b tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:11 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:14:11 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:11 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a223e8e9-baf6-4efa-9906-bf905755573e tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ab2b42f-440e-4553-982c-3cee43f355a1 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee" returned: 0 in 0.390s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:11 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-a223e8e9-baf6-4efa-9906-bf905755573e tempest-VolumesSnapshotTestJSON-999222795 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee is being set with open permissions: ugo+rw Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a223e8e9-baf6-4efa-9906-bf905755573e tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:11 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9d3714d6-d7bd-4abb-a060-937b103f2178 tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-58afb522-dfcf-4746-8086-718c4112adb2" returned: 0 in 0.328s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:11 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee Sep 28 17:14:11 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9d3714d6-d7bd-4abb-a060-937b103f2178 tempest-VolumesGetTest-661166036 None] Lock "cinder-quobyte-58afb522-dfcf-4746-8086-718c4112adb2" released by "delete_volume" :: held 0.892s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-9d3714d6-d7bd-4abb-a060-937b103f2178 tempest-VolumesGetTest-661166036 None] Created reservations ['2a0deacb-63d9-4a78-ba0d-3f27398d0298', '7ebd5265-aab5-4232-ace3-d513f69d507a', '72ed4bcb-70a7-494e-bbe8-9158b3657add', '2b0d6814-498b-42eb-92e9-ea8f258c232f'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:12 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ba34e073-7cfa-4fa9-ac37-02c32b2ced3b tempest-CreateVolumesFromImageTest-1521462606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.396s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-ba34e073-7cfa-4fa9-ac37-02c32b2ced3b tempest-CreateVolumesFromImageTest-1521462606 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:12 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-ba34e073-7cfa-4fa9-ac37-02c32b2ced3b tempest-CreateVolumesFromImageTest-1521462606 None] Deleted volume successfully. Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9d3714d6-d7bd-4abb-a060-937b103f2178 tempest-VolumesGetTest-661166036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9d3714d6-d7bd-4abb-a060-937b103f2178 tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9d3714d6-d7bd-4abb-a060-937b103f2178 tempest-VolumesGetTest-661166036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9d3714d6-d7bd-4abb-a060-937b103f2178 tempest-VolumesGetTest-661166036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9d3714d6-d7bd-4abb-a060-937b103f2178 tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9d3714d6-d7bd-4abb-a060-937b103f2178 tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ba34e073-7cfa-4fa9-ac37-02c32b2ced3b tempest-CreateVolumesFromImageTest-1521462606 None] Lock "cinder-43107586-e0e1-49d8-85b1-00d6e3a92029-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:12 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:14:12 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:12 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a223e8e9-baf6-4efa-9906-bf905755573e tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee" returned: 0 in 0.337s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a223e8e9-baf6-4efa-9906-bf905755573e tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:12 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.info Sep 28 17:14:12 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4abf493d-4fba-4a98-8084-368ecc1824ef tempest-VolumesGetTest-661166036 None] Acquiring lock "cinder-031ca85b-3fef-43eb-b98e-a8dd47ad185a-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4abf493d-4fba-4a98-8084-368ecc1824ef tempest-VolumesGetTest-661166036 None] Lock "cinder-031ca85b-3fef-43eb-b98e-a8dd47ad185a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4abf493d-4fba-4a98-8084-368ecc1824ef tempest-VolumesGetTest-661166036 None] Acquiring lock "cinder-quobyte-031ca85b-3fef-43eb-b98e-a8dd47ad185a" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4abf493d-4fba-4a98-8084-368ecc1824ef tempest-VolumesGetTest-661166036 None] Lock "cinder-quobyte-031ca85b-3fef-43eb-b98e-a8dd47ad185a" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbdab0e-6ba9-4a0b-a9c9-51ff6e26c1f8]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4abf493d-4fba-4a98-8084-368ecc1824ef tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-031ca85b-3fef-43eb-b98e-a8dd47ad185a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:12 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9d3714d6-d7bd-4abb-a060-937b103f2178 tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.394s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-9d3714d6-d7bd-4abb-a060-937b103f2178 tempest-VolumesGetTest-661166036 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:12 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-9d3714d6-d7bd-4abb-a060-937b103f2178 tempest-VolumesGetTest-661166036 None] Deleted volume successfully. Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9d3714d6-d7bd-4abb-a060-937b103f2178 tempest-VolumesGetTest-661166036 None] Lock "cinder-58afb522-dfcf-4746-8086-718c4112adb2-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:12 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a223e8e9-baf6-4efa-9906-bf905755573e tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.info" returned: 0 in 0.423s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:12 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-a223e8e9-baf6-4efa-9906-bf905755573e tempest-VolumesSnapshotTestJSON-999222795 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.info is being set with open permissions: ugo+rw Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a223e8e9-baf6-4efa-9906-bf905755573e tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:12 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-031ca85b-3fef-43eb-b98e-a8dd47ad185a Sep 28 17:14:12 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:12 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.info Sep 28 17:14:12 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7e701ee9-88d7-4540-8091-2223d74efdac tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "cinder-ce821c5b-465e-475b-aa03-ca549155d239-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7e701ee9-88d7-4540-8091-2223d74efdac tempest-CreateVolumesFromImageTest-1521462606 None] Lock "cinder-ce821c5b-465e-475b-aa03-ca549155d239-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7e701ee9-88d7-4540-8091-2223d74efdac tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "cinder-quobyte-ce821c5b-465e-475b-aa03-ca549155d239" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7e701ee9-88d7-4540-8091-2223d74efdac tempest-CreateVolumesFromImageTest-1521462606 None] Lock "cinder-quobyte-ce821c5b-465e-475b-aa03-ca549155d239" acquired by "delete_volume" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddf0413-551b-4b6f-9300-a80a171c67b9]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7e701ee9-88d7-4540-8091-2223d74efdac tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce821c5b-465e-475b-aa03-ca549155d239 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:13 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a223e8e9-baf6-4efa-9906-bf905755573e tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.info" returned: 0 in 0.378s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:13 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a223e8e9-baf6-4efa-9906-bf905755573e tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.722s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-8f2359b3-d22b-4fe0-8de5-c1722a878552 req-dc045d88-a8fb-48de-b074-a10313f6f240 tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.409s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4abf493d-4fba-4a98-8084-368ecc1824ef tempest-VolumesGetTest-661166036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-031ca85b-3fef-43eb-b98e-a8dd47ad185a" returned: 0 in 0.640s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4abf493d-4fba-4a98-8084-368ecc1824ef tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-031ca85b-3fef-43eb-b98e-a8dd47ad185a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:13 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce821c5b-465e-475b-aa03-ca549155d239 Sep 28 17:14:13 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:13 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-031ca85b-3fef-43eb-b98e-a8dd47ad185a Sep 28 17:14:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-8f2359b3-d22b-4fe0-8de5-c1722a878552 req-dc045d88-a8fb-48de-b074-a10313f6f240 tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:13 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:13 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a223e8e9-baf6-4efa-9906-bf905755573e tempest-VolumesSnapshotTestJSON-999222795 None] Create snapshot completed successfully Sep 28 17:14:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-8f2359b3-d22b-4fe0-8de5-c1722a878552 req-dc045d88-a8fb-48de-b074-a10313f6f240 tempest-AttachVolumeTestJSON-1078994482 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e27af7f-6e7a-47d3-a47d-065ef180b1b4', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:14:13 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-8f2359b3-d22b-4fe0-8de5-c1722a878552 req-dc045d88-a8fb-48de-b074-a10313f6f240 tempest-AttachVolumeTestJSON-1078994482 None] attachment_update completed successfully. Sep 28 17:14:13 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4abf493d-4fba-4a98-8084-368ecc1824ef tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-031ca85b-3fef-43eb-b98e-a8dd47ad185a" returned: 0 in 0.381s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4abf493d-4fba-4a98-8084-368ecc1824ef tempest-VolumesGetTest-661166036 None] Lock "cinder-quobyte-031ca85b-3fef-43eb-b98e-a8dd47ad185a" released by "delete_volume" :: held 1.076s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:13 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-4abf493d-4fba-4a98-8084-368ecc1824ef tempest-VolumesGetTest-661166036 None] Created reservations ['00f583aa-e351-4482-b248-1762ae915814', '2090b3ba-7320-4ca6-8aee-0fe2bc075035', '1dbeecb8-2bf2-4c10-9a7a-bfa714e7012c', '30cee763-fac4-401a-8486-9ca3087c32e4'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:13 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7e701ee9-88d7-4540-8091-2223d74efdac tempest-CreateVolumesFromImageTest-1521462606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce821c5b-465e-475b-aa03-ca549155d239" returned: 0 in 0.609s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7e701ee9-88d7-4540-8091-2223d74efdac tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce821c5b-465e-475b-aa03-ca549155d239 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:13 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce821c5b-465e-475b-aa03-ca549155d239 Sep 28 17:14:13 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4abf493d-4fba-4a98-8084-368ecc1824ef tempest-VolumesGetTest-661166036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4abf493d-4fba-4a98-8084-368ecc1824ef tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:13 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4abf493d-4fba-4a98-8084-368ecc1824ef tempest-VolumesGetTest-661166036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:13 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4abf493d-4fba-4a98-8084-368ecc1824ef tempest-VolumesGetTest-661166036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4abf493d-4fba-4a98-8084-368ecc1824ef tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4abf493d-4fba-4a98-8084-368ecc1824ef tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:13 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:14:13 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:13 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7e701ee9-88d7-4540-8091-2223d74efdac tempest-CreateVolumesFromImageTest-1521462606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce821c5b-465e-475b-aa03-ca549155d239" returned: 0 in 0.362s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7e701ee9-88d7-4540-8091-2223d74efdac tempest-CreateVolumesFromImageTest-1521462606 None] Lock "cinder-quobyte-ce821c5b-465e-475b-aa03-ca549155d239" released by "delete_volume" :: held 1.051s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:14 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4abf493d-4fba-4a98-8084-368ecc1824ef tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.324s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:14 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-4abf493d-4fba-4a98-8084-368ecc1824ef tempest-VolumesGetTest-661166036 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:14 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-4abf493d-4fba-4a98-8084-368ecc1824ef tempest-VolumesGetTest-661166036 None] Deleted volume successfully. Sep 28 17:14:14 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-7e701ee9-88d7-4540-8091-2223d74efdac tempest-CreateVolumesFromImageTest-1521462606 None] Created reservations ['328e8ccc-d114-4cce-a2a0-be62cd928117', 'c28e23a9-cd99-4685-93bf-8ce8151b3b1b', '52017e7c-516f-45e7-9f17-e2b65ab93552', 'd99e5cc1-d447-4745-8269-5bcfa45f2f42'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4abf493d-4fba-4a98-8084-368ecc1824ef tempest-VolumesGetTest-661166036 None] Lock "cinder-031ca85b-3fef-43eb-b98e-a8dd47ad185a-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7e701ee9-88d7-4540-8091-2223d74efdac tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7e701ee9-88d7-4540-8091-2223d74efdac tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:14 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7e701ee9-88d7-4540-8091-2223d74efdac tempest-CreateVolumesFromImageTest-1521462606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:14 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7e701ee9-88d7-4540-8091-2223d74efdac tempest-CreateVolumesFromImageTest-1521462606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7e701ee9-88d7-4540-8091-2223d74efdac tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7e701ee9-88d7-4540-8091-2223d74efdac tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:14 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:14:14 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:14 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7e701ee9-88d7-4540-8091-2223d74efdac tempest-CreateVolumesFromImageTest-1521462606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.348s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:14 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-7e701ee9-88d7-4540-8091-2223d74efdac tempest-CreateVolumesFromImageTest-1521462606 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:14 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-7e701ee9-88d7-4540-8091-2223d74efdac tempest-CreateVolumesFromImageTest-1521462606 None] Deleted volume successfully. Sep 28 17:14:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7e701ee9-88d7-4540-8091-2223d74efdac tempest-CreateVolumesFromImageTest-1521462606 None] Lock "cinder-ce821c5b-465e-475b-aa03-ca549155d239-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-69607a8a-766a-4967-ad8b-382960df4dca tempest-VolumesGetTest-661166036 None] Acquiring lock "cinder-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-69607a8a-766a-4967-ad8b-382960df4dca tempest-VolumesGetTest-661166036 None] Lock "cinder-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-69607a8a-766a-4967-ad8b-382960df4dca tempest-VolumesGetTest-661166036 None] Acquiring lock "cinder-quobyte-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-69607a8a-766a-4967-ad8b-382960df4dca tempest-VolumesGetTest-661166036 None] Lock "cinder-quobyte-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc" acquired by "delete_volume" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:14 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6543d7-76db-4d0c-bb26-39c9dd2c1503]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-69607a8a-766a-4967-ad8b-382960df4dca tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:15 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc Sep 28 17:14:15 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Flow 'volume_create_manager' (46c7d6be-1b81-420b-b44f-6267a994404b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4381f34-cb0b-42c0-ae29-9411d6a12574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4381f34-cb0b-42c0-ae29-9411d6a12574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-248108377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be18c637-68ab-45a8-b54e-039cee1570e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1597d278c62544538f0172cd1292f3dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b0775792-1d96-4a1b-b4f4-c55b8965b2ee,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:15Z,use_quota=True,user_id='e598fcac75cb44488aca25b98e029a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01b0abc-8737-4d4b-a59e-d2cffc0e4cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01b0abc-8737-4d4b-a59e-d2cffc0e4cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edef3fbc-d2a2-4c65-87f6-480fa28cb844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edef3fbc-d2a2-4c65-87f6-480fa28cb844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'be18c637-68ab-45a8-b54e-039cee1570e6', 'volume_name': 'volume-be18c637-68ab-45a8-b54e-039cee1570e6', 'volume_size': 2, 'snapshot_id': 'b0775792-1d96-4a1b-b4f4-c55b8965b2ee'}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8e30d2-024f-4615-b627-18118f53d5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8e30d2-024f-4615-b627-18118f53d5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a8f9a1-c3b0-4f43-9b1e-2443ea79ef66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:15 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Volume be18c637-68ab-45a8-b54e-039cee1570e6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-be18c637-68ab-45a8-b54e-039cee1570e6', 'volume_size': 2, 'snapshot_id': 'b0775792-1d96-4a1b-b4f4-c55b8965b2ee'} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0cfbeae7-371f-4dc1-9b69-493df1e0fbe9 tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "cinder-b7800e94-8b1d-415e-a484-f7897a14790b-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.005s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-quobyte-b0775792-1d96-4a1b-b4f4-c55b8965b2ee-be18c637-68ab-45a8-b54e-039cee1570e6" by "_create_volume_from_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0cfbeae7-371f-4dc1-9b69-493df1e0fbe9 tempest-CreateVolumesFromImageTest-1521462606 None] Lock "cinder-b7800e94-8b1d-415e-a484-f7897a14790b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-b0775792-1d96-4a1b-b4f4-c55b8965b2ee-be18c637-68ab-45a8-b54e-039cee1570e6" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Creating volume be18c637-68ab-45a8-b54e-039cee1570e6 from snapshot b0775792-1d96-4a1b-b4f4-c55b8965b2ee {{(pid=87061) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-quobyte-be18c637-68ab-45a8-b54e-039cee1570e6" by "_copy_volume_from_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-be18c637-68ab-45a8-b54e-039cee1570e6" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] snapshot: b0775792-1d96-4a1b-b4f4-c55b8965b2ee, volume: be18c637-68ab-45a8-b54e-039cee1570e6, {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:15 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-69607a8a-766a-4967-ad8b-382960df4dca tempest-VolumesGetTest-661166036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc" returned: 0 in 0.512s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-69607a8a-766a-4967-ad8b-382960df4dca tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39b0310-5f88-4993-8938-f70d5d770ac7]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0cfbeae7-371f-4dc1-9b69-493df1e0fbe9 tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "cinder-quobyte-b7800e94-8b1d-415e-a484-f7897a14790b" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:15 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc Sep 28 17:14:15 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0cfbeae7-371f-4dc1-9b69-493df1e0fbe9 tempest-CreateVolumesFromImageTest-1521462606 None] Lock "cinder-quobyte-b7800e94-8b1d-415e-a484-f7897a14790b" acquired by "delete_volume" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb85eec9-5076-417c-90b6-e9f4b7162a67]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0cfbeae7-371f-4dc1-9b69-493df1e0fbe9 tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b7800e94-8b1d-415e-a484-f7897a14790b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:15 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee Sep 28 17:14:15 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:15 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b7800e94-8b1d-415e-a484-f7897a14790b Sep 28 17:14:15 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:15 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-69607a8a-766a-4967-ad8b-382960df4dca tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc" returned: 0 in 0.383s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-69607a8a-766a-4967-ad8b-382960df4dca tempest-VolumesGetTest-661166036 None] Lock "cinder-quobyte-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc" released by "delete_volume" :: held 0.993s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:15 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-69607a8a-766a-4967-ad8b-382960df4dca tempest-VolumesGetTest-661166036 None] Created reservations ['b5f85d61-87d1-4e9a-951d-f2fc2cd7168d', '4dcfa622-e071-4dfb-a23e-18a7e49cfd04', 'a138c43b-eb85-4133-988a-7b9b3c9efdad', '14b42725-b8fd-4761-b81a-9d22cff0d563'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:16 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee" returned: 0 in 0.607s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ab2b42f-440e-4553-982c-3cee43f355a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b656c8-dfe9-4060-8582-8e11715a4ae3]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:16 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0cfbeae7-371f-4dc1-9b69-493df1e0fbe9 tempest-CreateVolumesFromImageTest-1521462606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b7800e94-8b1d-415e-a484-f7897a14790b" returned: 0 in 0.579s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0cfbeae7-371f-4dc1-9b69-493df1e0fbe9 tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b7800e94-8b1d-415e-a484-f7897a14790b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-69607a8a-766a-4967-ad8b-382960df4dca tempest-VolumesGetTest-661166036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-69607a8a-766a-4967-ad8b-382960df4dca tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-69607a8a-766a-4967-ad8b-382960df4dca tempest-VolumesGetTest-661166036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-69607a8a-766a-4967-ad8b-382960df4dca tempest-VolumesGetTest-661166036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-69607a8a-766a-4967-ad8b-382960df4dca tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-69607a8a-766a-4967-ad8b-382960df4dca tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:16 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b7800e94-8b1d-415e-a484-f7897a14790b Sep 28 17:14:16 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:16 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:14:16 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:16 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1 Sep 28 17:14:16 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Flow 'volume_create_manager' (49a356fb-9a4c-4c91-b685-b341042c646f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af73781-d6e2-481d-bb4f-0f7a4fe7cbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af73781-d6e2-481d-bb4f-0f7a4fe7cbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-12329825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba5bc539-e2c6-4f56-b9d1-91f6d7708599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='231130faf28c40e7bf079851c5b01fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:16Z,use_quota=True,user_id='26950c66128241f9ad7e87131160c4e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d2d568-7473-4f1e-8c75-29922ff234c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d2d568-7473-4f1e-8c75-29922ff234c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa37ba7a-2bf7-4e11-967d-95a1ff084a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa37ba7a-2bf7-4e11-967d-95a1ff084a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba5bc539-e2c6-4f56-b9d1-91f6d7708599', 'volume_name': 'volume-ba5bc539-e2c6-4f56-b9d1-91f6d7708599', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9fe5451-8844-488e-9d13-60b1a7f448c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9fe5451-8844-488e-9d13-60b1a7f448c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be06974b-8861-4625-afe4-12a45e348e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:16 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Volume ba5bc539-e2c6-4f56-b9d1-91f6d7708599: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba5bc539-e2c6-4f56-b9d1-91f6d7708599', 'volume_size': 1} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:16 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-69607a8a-766a-4967-ad8b-382960df4dca tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.336s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-69607a8a-766a-4967-ad8b-382960df4dca tempest-VolumesGetTest-661166036 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:16 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0cfbeae7-371f-4dc1-9b69-493df1e0fbe9 tempest-CreateVolumesFromImageTest-1521462606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b7800e94-8b1d-415e-a484-f7897a14790b" returned: 0 in 0.371s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0cfbeae7-371f-4dc1-9b69-493df1e0fbe9 tempest-CreateVolumesFromImageTest-1521462606 None] Lock "cinder-quobyte-b7800e94-8b1d-415e-a484-f7897a14790b" released by "delete_volume" :: held 1.012s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:16 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-69607a8a-766a-4967-ad8b-382960df4dca tempest-VolumesGetTest-661166036 None] Deleted volume successfully. Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-69607a8a-766a-4967-ad8b-382960df4dca tempest-VolumesGetTest-661166036 None] Lock "cinder-d5449cdd-fdef-40f4-9bdc-7be0498bf2bc-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:16 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1" returned: 0 in 0.485s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1 {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Creating direct copy from snapshot {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.utils [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Path /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-be18c637-68ab-45a8-b54e-039cee1570e6 not found in is_blk_device check {{(pid=87061) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-be18c637-68ab-45a8-b54e-039cee1570e6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-0cfbeae7-371f-4dc1-9b69-493df1e0fbe9 tempest-CreateVolumesFromImageTest-1521462606 None] Created reservations ['e17fd336-f2cb-463d-8ec5-d0b9ec6c1a00', '3cd65815-bec3-4613-9cff-789c0ac4e7fd', 'b29b46a7-d827-4cf9-a130-ba7931254af3', 'becf8a78-2d38-4118-b25a-e15ed694a60d'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:16 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-be18c637-68ab-45a8-b54e-039cee1570e6 Sep 28 17:14:16 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0cfbeae7-371f-4dc1-9b69-493df1e0fbe9 tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0cfbeae7-371f-4dc1-9b69-493df1e0fbe9 tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0cfbeae7-371f-4dc1-9b69-493df1e0fbe9 tempest-CreateVolumesFromImageTest-1521462606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0cfbeae7-371f-4dc1-9b69-493df1e0fbe9 tempest-CreateVolumesFromImageTest-1521462606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0cfbeae7-371f-4dc1-9b69-493df1e0fbe9 tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0cfbeae7-371f-4dc1-9b69-493df1e0fbe9 tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:16 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:14:16 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:17 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0cfbeae7-371f-4dc1-9b69-493df1e0fbe9 tempest-CreateVolumesFromImageTest-1521462606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.278s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:17 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-0cfbeae7-371f-4dc1-9b69-493df1e0fbe9 tempest-CreateVolumesFromImageTest-1521462606 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:17 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-0cfbeae7-371f-4dc1-9b69-493df1e0fbe9 tempest-CreateVolumesFromImageTest-1521462606 None] Deleted volume successfully. Sep 28 17:14:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0cfbeae7-371f-4dc1-9b69-493df1e0fbe9 tempest-CreateVolumesFromImageTest-1521462606 None] Lock "cinder-b7800e94-8b1d-415e-a484-f7897a14790b-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f854c5dc-0040-4fac-9aaf-aa84581743f1 tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "cinder-ae1ebeec-2771-4844-b35b-3491918c984d-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f854c5dc-0040-4fac-9aaf-aa84581743f1 tempest-CreateVolumesFromImageTest-1521462606 None] Lock "cinder-ae1ebeec-2771-4844-b35b-3491918c984d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f854c5dc-0040-4fac-9aaf-aa84581743f1 tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "cinder-quobyte-ae1ebeec-2771-4844-b35b-3491918c984d" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f854c5dc-0040-4fac-9aaf-aa84581743f1 tempest-CreateVolumesFromImageTest-1521462606 None] Lock "cinder-quobyte-ae1ebeec-2771-4844-b35b-3491918c984d" acquired by "delete_volume" :: waited 0.047s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:18 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca335ef8-15ad-4f46-b4ca-39ac677b025c]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f854c5dc-0040-4fac-9aaf-aa84581743f1 tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae1ebeec-2771-4844-b35b-3491918c984d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:18 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae1ebeec-2771-4844-b35b-3491918c984d Sep 28 17:14:18 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:18 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Flow 'volume_create_manager' (bb3f0de5-9edb-4359-be09-763c9a9ce1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de8c53d3-0a8f-48fb-9eb2-fb6361185702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de8c53d3-0a8f-48fb-9eb2-fb6361185702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-654775975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f297417e-f577-4a3c-90d8-aac04a09f87d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a47cfc0470734f5a9cf32d38abedcf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:19Z,use_quota=True,user_id='2819d7ed92b34793956b001a87a2f252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a9a057-aed7-4484-8070-60f732e4a3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a9a057-aed7-4484-8070-60f732e4a3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a0fa09-13e8-46b9-92d2-ad620f8da61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:18 devstack cinder-volume[87061]: DEBUG cinder.image.glance [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Creating Keystone auth plugin from conf {{(pid=87061) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:14:19 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f854c5dc-0040-4fac-9aaf-aa84581743f1 tempest-CreateVolumesFromImageTest-1521462606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae1ebeec-2771-4844-b35b-3491918c984d" returned: 0 in 1.035s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f854c5dc-0040-4fac-9aaf-aa84581743f1 tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae1ebeec-2771-4844-b35b-3491918c984d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:19 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae1ebeec-2771-4844-b35b-3491918c984d Sep 28 17:14:19 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:19 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f854c5dc-0040-4fac-9aaf-aa84581743f1 tempest-CreateVolumesFromImageTest-1521462606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ae1ebeec-2771-4844-b35b-3491918c984d" returned: 0 in 0.449s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:19 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f854c5dc-0040-4fac-9aaf-aa84581743f1 tempest-CreateVolumesFromImageTest-1521462606 None] Lock "cinder-quobyte-ae1ebeec-2771-4844-b35b-3491918c984d" released by "delete_volume" :: held 1.568s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:19 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-f854c5dc-0040-4fac-9aaf-aa84581743f1 tempest-CreateVolumesFromImageTest-1521462606 None] Created reservations ['8ce99fa1-eb29-475b-b74e-ab92d2652450', '168718ef-90a0-41ce-b052-abe3bb72145a', '096374ca-57ff-4636-bb69-a4e3ec90f23e', 'fcbe976e-502f-4428-acac-e58ebac7a085'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f854c5dc-0040-4fac-9aaf-aa84581743f1 tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f854c5dc-0040-4fac-9aaf-aa84581743f1 tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f854c5dc-0040-4fac-9aaf-aa84581743f1 tempest-CreateVolumesFromImageTest-1521462606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f854c5dc-0040-4fac-9aaf-aa84581743f1 tempest-CreateVolumesFromImageTest-1521462606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f854c5dc-0040-4fac-9aaf-aa84581743f1 tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f854c5dc-0040-4fac-9aaf-aa84581743f1 tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a0fa09-13e8-46b9-92d2-ad620f8da61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f297417e-f577-4a3c-90d8-aac04a09f87d', 'volume_name': 'volume-f297417e-f577-4a3c-90d8-aac04a09f87d', 'volume_size': 1, 'image_id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21d27c6a4ac749c0a5b3cbd558b3b102', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'created_at': datetime.datetime(2026, 9, 28, 14, 57, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3da6edc3-4055-4154-be43-a897ff97d7cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:19 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:14:20 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:20 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ba6e11-afd7-4b17-bcb4-761057a90cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:20 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ba6e11-afd7-4b17-bcb4-761057a90cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:20 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b96965-a308-457c-b59a-b6e10811be9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:20 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Volume f297417e-f577-4a3c-90d8-aac04a09f87d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f297417e-f577-4a3c-90d8-aac04a09f87d', 'volume_size': 1, 'image_id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21d27c6a4ac749c0a5b3cbd558b3b102', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'created_at': datetime.datetime(2026, 9, 28, 14, 57, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3da6edc3-4055-4154-be43-a897ff97d7cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:14:20 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Trying to clone f297417e-f577-4a3c-90d8-aac04a09f87d from image 3da6edc3-4055-4154-be43-a897ff97d7cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}]). {{(pid=87061) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:14:20 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-81c1d0e1-d910-474a-8afc-c24ca92099ee tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "cinder-956bf41a-7497-4279-8077-39facf65c5f3-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:20 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:20 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-81c1d0e1-d910-474a-8afc-c24ca92099ee tempest-CreateVolumesFromImageTest-1521462606 None] Lock "cinder-956bf41a-7497-4279-8077-39facf65c5f3-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f854c5dc-0040-4fac-9aaf-aa84581743f1 tempest-CreateVolumesFromImageTest-1521462606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.539s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:20 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-f854c5dc-0040-4fac-9aaf-aa84581743f1 tempest-CreateVolumesFromImageTest-1521462606 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:20 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-f854c5dc-0040-4fac-9aaf-aa84581743f1 tempest-CreateVolumesFromImageTest-1521462606 None] Deleted volume successfully. Sep 28 17:14:20 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f854c5dc-0040-4fac-9aaf-aa84581743f1 tempest-CreateVolumesFromImageTest-1521462606 None] Lock "cinder-ae1ebeec-2771-4844-b35b-3491918c984d-delete_volume" released by "delete_volume" :: held 2.906s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:20 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-81c1d0e1-d910-474a-8afc-c24ca92099ee tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "cinder-quobyte-956bf41a-7497-4279-8077-39facf65c5f3" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:20 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-81c1d0e1-d910-474a-8afc-c24ca92099ee tempest-CreateVolumesFromImageTest-1521462606 None] Lock "cinder-quobyte-956bf41a-7497-4279-8077-39facf65c5f3" acquired by "delete_volume" :: waited 0.049s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:20 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fcc88f-5183-4428-94a2-df98d0513753]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-81c1d0e1-d910-474a-8afc-c24ca92099ee tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-956bf41a-7497-4279-8077-39facf65c5f3 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:20 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_asj4_e8pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:14:20 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:14:21 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dbf2f2-385b-448c-8d1e-76f92dca3d04]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_asj4_e8pdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:21 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-956bf41a-7497-4279-8077-39facf65c5f3 Sep 28 17:14:21 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:21 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_asj4_e8pdevstack@QuobyteHD Sep 28 17:14:21 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:21 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-81c1d0e1-d910-474a-8afc-c24ca92099ee tempest-CreateVolumesFromImageTest-1521462606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-956bf41a-7497-4279-8077-39facf65c5f3" returned: 0 in 0.814s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-81c1d0e1-d910-474a-8afc-c24ca92099ee tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-956bf41a-7497-4279-8077-39facf65c5f3 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:21 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-956bf41a-7497-4279-8077-39facf65c5f3 Sep 28 17:14:21 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:21 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_asj4_e8pdevstack@QuobyteHD" returned: 0 in 0.747s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:21 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Temporary image 3da6edc3-4055-4154-be43-a897ff97d7cf is fetched for user 2819d7ed92b34793956b001a87a2f252. {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:14:22 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[651913bf-1815-4273-a401-76506ba49683]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_asj4_e8pdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:22 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-81c1d0e1-d910-474a-8afc-c24ca92099ee tempest-CreateVolumesFromImageTest-1521462606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-956bf41a-7497-4279-8077-39facf65c5f3" returned: 0 in 0.647s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:22 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_asj4_e8pdevstack@QuobyteHD Sep 28 17:14:22 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:22 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-81c1d0e1-d910-474a-8afc-c24ca92099ee tempest-CreateVolumesFromImageTest-1521462606 None] Lock "cinder-quobyte-956bf41a-7497-4279-8077-39facf65c5f3" released by "delete_volume" :: held 1.572s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:22 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-81c1d0e1-d910-474a-8afc-c24ca92099ee tempest-CreateVolumesFromImageTest-1521462606 None] Created reservations ['f6df6dbe-f388-47fa-bb29-285970cb2976', '89e76972-572e-43cc-b123-3ccd3a679b78', '4409f2cc-d17b-4c0b-b012-bc51ce09ad21', 'd6b3ccdb-5eb4-4d78-8021-6d88035e8707'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-81c1d0e1-d910-474a-8afc-c24ca92099ee tempest-CreateVolumesFromImageTest-1521462606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-81c1d0e1-d910-474a-8afc-c24ca92099ee tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:22 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-81c1d0e1-d910-474a-8afc-c24ca92099ee tempest-CreateVolumesFromImageTest-1521462606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:22 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-81c1d0e1-d910-474a-8afc-c24ca92099ee tempest-CreateVolumesFromImageTest-1521462606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-81c1d0e1-d910-474a-8afc-c24ca92099ee tempest-CreateVolumesFromImageTest-1521462606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-81c1d0e1-d910-474a-8afc-c24ca92099ee tempest-CreateVolumesFromImageTest-1521462606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:22 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:14:22 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:22 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_asj4_e8pdevstack@QuobyteHD" returned: 0 in 0.910s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:23 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-81c1d0e1-d910-474a-8afc-c24ca92099ee tempest-CreateVolumesFromImageTest-1521462606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.655s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:23 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-81c1d0e1-d910-474a-8afc-c24ca92099ee tempest-CreateVolumesFromImageTest-1521462606 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:23 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-81c1d0e1-d910-474a-8afc-c24ca92099ee tempest-CreateVolumesFromImageTest-1521462606 None] Deleted volume successfully. Sep 28 17:14:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-81c1d0e1-d910-474a-8afc-c24ca92099ee tempest-CreateVolumesFromImageTest-1521462606 None] Lock "cinder-956bf41a-7497-4279-8077-39facf65c5f3-delete_volume" released by "delete_volume" :: held 3.026s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:25 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-be18c637-68ab-45a8-b54e-039cee1570e6" returned: 0 in 8.762s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:25 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Image conversion details: src /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1, size 1024.00 MB, duration 8.76 sec, destination /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-be18c637-68ab-45a8-b54e-039cee1570e6 {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:14:25 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Converted 1024.00 MB image at 116.86 MB/s Sep 28 17:14:25 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-be18c637-68ab-45a8-b54e-039cee1570e6 is being set with open permissions: ugo+rw Sep 28 17:14:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-be18c637-68ab-45a8-b54e-039cee1570e6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:25 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-be18c637-68ab-45a8-b54e-039cee1570e6 Sep 28 17:14:25 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:25 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-be18c637-68ab-45a8-b54e-039cee1570e6" returned: 0 in 0.309s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:25 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-be18c637-68ab-45a8-b54e-039cee1570e6" released by "_copy_volume_from_snapshot" :: held 10.330s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:25 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-b0775792-1d96-4a1b-b4f4-c55b8965b2ee-be18c637-68ab-45a8-b54e-039cee1570e6" released by "_create_volume_from_snapshot" :: held 10.419s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.448s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.355s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:25 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-12329825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba5bc539-e2c6-4f56-b9d1-91f6d7708599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='231130faf28c40e7bf079851c5b01fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:16Z,use_quota=True,user_id='26950c66128241f9ad7e87131160c4e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:25 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Creating volume ba5bc539-e2c6-4f56-b9d1-91f6d7708599 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:25 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:25 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:25 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:25 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:14:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ba5bc539-e2c6-4f56-b9d1-91f6d7708599 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:25 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ba5bc539-e2c6-4f56-b9d1-91f6d7708599 1073741824 Sep 28 17:14:25 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a8f9a1-c3b0-4f43-9b1e-2443ea79ef66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be18c637-68ab-45a8-b54e-039cee1570e6', 'volume_size': 2, 'snapshot_id': 'b0775792-1d96-4a1b-b4f4-c55b8965b2ee'}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af2d637f-3de0-4250-8212-036b9d0532e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:25 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Volume volume-be18c637-68ab-45a8-b54e-039cee1570e6 (be18c637-68ab-45a8-b54e-039cee1570e6): created successfully Sep 28 17:14:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af2d637f-3de0-4250-8212-036b9d0532e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Flow 'volume_create_manager' (46c7d6be-1b81-420b-b44f-6267a994404b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:25 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-be968dc6-51ce-4115-99e2-39e8c9f21c47 tempest-VolumesSnapshotTestJSON-999222795 None] Created volume successfully. Sep 28 17:14:26 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ba5bc539-e2c6-4f56-b9d1-91f6d7708599 1073741824" returned: 0 in 0.565s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ba5bc539-e2c6-4f56-b9d1-91f6d7708599 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:26 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ba5bc539-e2c6-4f56-b9d1-91f6d7708599 Sep 28 17:14:26 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fa85bcc7-5a34-4785-9485-30272fb505c1 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-be18c637-68ab-45a8-b54e-039cee1570e6-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fa85bcc7-5a34-4785-9485-30272fb505c1 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-be18c637-68ab-45a8-b54e-039cee1570e6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fa85bcc7-5a34-4785-9485-30272fb505c1 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-quobyte-be18c637-68ab-45a8-b54e-039cee1570e6" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:26 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ba5bc539-e2c6-4f56-b9d1-91f6d7708599" returned: 0 in 0.396s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.783s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-654775975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f297417e-f577-4a3c-90d8-aac04a09f87d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a47cfc0470734f5a9cf32d38abedcf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:19Z,use_quota=True,user_id='2819d7ed92b34793956b001a87a2f252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Creating volume f297417e-f577-4a3c-90d8-aac04a09f87d {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:26 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f297417e-f577-4a3c-90d8-aac04a09f87d 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fa85bcc7-5a34-4785-9485-30272fb505c1 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-be18c637-68ab-45a8-b54e-039cee1570e6" acquired by "delete_volume" :: waited 0.071s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:26 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f297417e-f577-4a3c-90d8-aac04a09f87d 1073741824 Sep 28 17:14:26 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be06974b-8861-4625-afe4-12a45e348e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba5bc539-e2c6-4f56-b9d1-91f6d7708599', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cbbf8d6-11ab-49ab-8773-d25c6b6102fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf72056b-5d6f-47b6-987e-79effc992cfc]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fa85bcc7-5a34-4785-9485-30272fb505c1 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-be18c637-68ab-45a8-b54e-039cee1570e6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:26 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Volume volume-ba5bc539-e2c6-4f56-b9d1-91f6d7708599 (ba5bc539-e2c6-4f56-b9d1-91f6d7708599): created successfully Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cbbf8d6-11ab-49ab-8773-d25c6b6102fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Flow 'volume_create_manager' (49a356fb-9a4c-4c91-b685-b341042c646f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:26 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-c16741eb-60cd-4b8d-a169-4922e53991df tempest-AttachVolumeTestJSON-1078994482 None] Created volume successfully. Sep 28 17:14:27 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-be18c637-68ab-45a8-b54e-039cee1570e6 Sep 28 17:14:27 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:27 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f297417e-f577-4a3c-90d8-aac04a09f87d 1073741824" returned: 0 in 0.613s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:27 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fa85bcc7-5a34-4785-9485-30272fb505c1 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-be18c637-68ab-45a8-b54e-039cee1570e6" returned: 0 in 0.574s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fa85bcc7-5a34-4785-9485-30272fb505c1 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-be18c637-68ab-45a8-b54e-039cee1570e6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f297417e-f577-4a3c-90d8-aac04a09f87d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:27 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-be18c637-68ab-45a8-b54e-039cee1570e6 Sep 28 17:14:27 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:27 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f297417e-f577-4a3c-90d8-aac04a09f87d Sep 28 17:14:27 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:27 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fa85bcc7-5a34-4785-9485-30272fb505c1 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-be18c637-68ab-45a8-b54e-039cee1570e6" returned: 0 in 0.427s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:27 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fa85bcc7-5a34-4785-9485-30272fb505c1 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-be18c637-68ab-45a8-b54e-039cee1570e6" released by "delete_volume" :: held 1.092s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:27 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f297417e-f577-4a3c-90d8-aac04a09f87d" returned: 0 in 0.441s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:27 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:27 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Attempting download of 3da6edc3-4055-4154-be43-a897ff97d7cf ((None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}])) to volume f297417e-f577-4a3c-90d8-aac04a09f87d. {{(pid=87061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:14:28 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-fa85bcc7-5a34-4785-9485-30272fb505c1 tempest-VolumesSnapshotTestJSON-999222795 None] Created reservations ['7063a5fd-3b9f-40ae-8ba6-900d44018233', '16138bb6-c75c-41e4-a417-21d8f421df38', 'b4fbdc45-db59-451c-ba39-19ce2958ec34', '7906d3fd-28cd-4ee1-b3d2-50e8aef742c4'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:28 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1e9297-9865-4d70-b121-b032feb79ec9]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_mu3njkqk {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fa85bcc7-5a34-4785-9485-30272fb505c1 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fa85bcc7-5a34-4785-9485-30272fb505c1 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fa85bcc7-5a34-4785-9485-30272fb505c1 tempest-VolumesSnapshotTestJSON-999222795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fa85bcc7-5a34-4785-9485-30272fb505c1 tempest-VolumesSnapshotTestJSON-999222795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fa85bcc7-5a34-4785-9485-30272fb505c1 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fa85bcc7-5a34-4785-9485-30272fb505c1 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:28 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:14:28 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:28 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_mu3njkqk Sep 28 17:14:28 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:28 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_mu3njkqk" returned: 0 in 0.533s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_mu3njkqk {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:28 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fa85bcc7-5a34-4785-9485-30272fb505c1 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.470s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:28 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-fa85bcc7-5a34-4785-9485-30272fb505c1 tempest-VolumesSnapshotTestJSON-999222795 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:28 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-fa85bcc7-5a34-4785-9485-30272fb505c1 tempest-VolumesSnapshotTestJSON-999222795 None] Deleted volume successfully. Sep 28 17:14:28 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fa85bcc7-5a34-4785-9485-30272fb505c1 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-be18c637-68ab-45a8-b54e-039cee1570e6-delete_volume" released by "delete_volume" :: held 2.025s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:28 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_mu3njkqk Sep 28 17:14:28 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4e6745f7-2906-4b26-9746-450d2954d68a tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-b0775792-1d96-4a1b-b4f4-c55b8965b2ee-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:29 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_mu3njkqk" returned: 1 in 0.570s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_mu3njkqk' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4e6745f7-2906-4b26-9746-450d2954d68a tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-b0775792-1d96-4a1b-b4f4-c55b8965b2ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4e6745f7-2906-4b26-9746-450d2954d68a tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-quobyte-5ab2b42f-440e-4553-982c-3cee43f355a1" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[776ed24f-c61d-421d-bcfd-bc7d3ccc5a9c]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-e043f5ca-5817-4a96-8858-9a0722016dbd req-af873e07-1dfc-42fd-9190-86b42bfcd36a tempest-AttachVolumeTestJSON-1078994482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-e043f5ca-5817-4a96-8858-9a0722016dbd req-af873e07-1dfc-42fd-9190-86b42bfcd36a tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_asj4_e8pdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4e6745f7-2906-4b26-9746-450d2954d68a tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-5ab2b42f-440e-4553-982c-3cee43f355a1" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4e6745f7-2906-4b26-9746-450d2954d68a tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-quobyte-b0775792-1d96-4a1b-b4f4-c55b8965b2ee" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-e043f5ca-5817-4a96-8858-9a0722016dbd req-af873e07-1dfc-42fd-9190-86b42bfcd36a tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.055s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4e6745f7-2906-4b26-9746-450d2954d68a tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-b0775792-1d96-4a1b-b4f4-c55b8965b2ee" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-4e6745f7-2906-4b26-9746-450d2954d68a tempest-VolumesSnapshotTestJSON-999222795 None] Deleting offline snapshot b0775792-1d96-4a1b-b4f4-c55b8965b2ee of volume 5ab2b42f-440e-4553-982c-3cee43f355a1 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-4e6745f7-2906-4b26-9746-450d2954d68a tempest-VolumesSnapshotTestJSON-999222795 None] snapshot_file for this snap is: volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ed7b04-7575-494f-8ea9-f90f6ae1f707]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4e6745f7-2906-4b26-9746-450d2954d68a tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-e043f5ca-5817-4a96-8858-9a0722016dbd req-af873e07-1dfc-42fd-9190-86b42bfcd36a tempest-AttachVolumeTestJSON-1078994482 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-ba5bc539-e2c6-4f56-b9d1-91f6d7708599', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c7fd92a-35a4-4412-8a08-b1d8edfee15b', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:14:29 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_asj4_e8pdevstack@QuobyteHD Sep 28 17:14:29 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:29 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-e043f5ca-5817-4a96-8858-9a0722016dbd req-af873e07-1dfc-42fd-9190-86b42bfcd36a tempest-AttachVolumeTestJSON-1078994482 None] attachment_update completed successfully. Sep 28 17:14:29 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee Sep 28 17:14:29 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:29 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_asj4_e8pdevstack@QuobyteHD" returned: 0 in 0.523s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] 3da6edc3-4055-4154-be43-a897ff97d7cf was qcow2, converting to qcow2 {{(pid=87061) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_asj4_e8pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f297417e-f577-4a3c-90d8-aac04a09f87d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:29 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_asj4_e8pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f297417e-f577-4a3c-90d8-aac04a09f87d Sep 28 17:14:29 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:29 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4e6745f7-2906-4b26-9746-450d2954d68a tempest-VolumesSnapshotTestJSON-999222795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee" returned: 0 in 0.576s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-4e6745f7-2906-4b26-9746-450d2954d68a tempest-VolumesSnapshotTestJSON-999222795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ab2b42f-440e-4553-982c-3cee43f355a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e92124-6dcf-4ba7-9c1e-58a4f5784062]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4e6745f7-2906-4b26-9746-450d2954d68a tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:30 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1 Sep 28 17:14:30 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:30 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4e6745f7-2906-4b26-9746-450d2954d68a tempest-VolumesSnapshotTestJSON-999222795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1" returned: 0 in 0.791s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4e6745f7-2906-4b26-9746-450d2954d68a tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:30 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee Sep 28 17:14:30 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:31 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4e6745f7-2906-4b26-9746-450d2954d68a tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee" returned: 0 in 0.559s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4e6745f7-2906-4b26-9746-450d2954d68a tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:31 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee Sep 28 17:14:31 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:31 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4e6745f7-2906-4b26-9746-450d2954d68a tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1.b0775792-1d96-4a1b-b4f4-c55b8965b2ee" returned: 0 in 0.335s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4e6745f7-2906-4b26-9746-450d2954d68a tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-b0775792-1d96-4a1b-b4f4-c55b8965b2ee" released by "_delete_snapshot" :: held 2.455s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4e6745f7-2906-4b26-9746-450d2954d68a tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-5ab2b42f-440e-4553-982c-3cee43f355a1" released by "delete_snapshot" :: held 2.503s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:31 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-4e6745f7-2906-4b26-9746-450d2954d68a tempest-VolumesSnapshotTestJSON-999222795 None] Created reservations ['e3d6b475-0189-4829-8ed1-d33bbda18949', 'c31835cd-1879-4714-b4ab-9be57f7de90f', 'eb596f85-d04f-4ed1-9121-7ba99dc3c31c', 'cc160c3b-0912-4de3-8d2f-414d2618968a'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:31 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-4e6745f7-2906-4b26-9746-450d2954d68a tempest-VolumesSnapshotTestJSON-999222795 None] Delete snapshot completed successfully. Sep 28 17:14:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4e6745f7-2906-4b26-9746-450d2954d68a tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-b0775792-1d96-4a1b-b4f4-c55b8965b2ee-delete_snapshot" released by "delete_snapshot" :: held 2.775s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:32 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Flow 'volume_create_manager' (1076e9e6-2f7e-4bb7-88c0-8a85d233f2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ee775d-6b13-475e-940d-b01ca0e35108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ee775d-6b13-475e-940d-b01ca0e35108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f8a511-dfb2-473d-bb5f-2190aa84ee2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56fcd35d80048f2b5f755b79f8d2a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:32Z,use_quota=True,user_id='810b5a574c104f11815d29fa30f5bfac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecccfa0-7d7b-4e41-9453-9c400bcaa538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecccfa0-7d7b-4e41-9453-9c400bcaa538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dba4b72-22ae-4cf6-bad4-f848516f0612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:32 devstack cinder-volume[87061]: DEBUG cinder.image.glance [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Creating Keystone auth plugin from conf {{(pid=87061) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:14:32 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-aea3eae3-bb29-4814-8e7b-3b5230563d85 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-5ab2b42f-440e-4553-982c-3cee43f355a1-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:32 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-aea3eae3-bb29-4814-8e7b-3b5230563d85 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-5ab2b42f-440e-4553-982c-3cee43f355a1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:32 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-95c9ca57-ce53-4a6e-bca5-b540a21df8da req-9845bfd9-fd6a-426d-8a7f-4ae4a1f0dde9 tempest-AttachVolumeTestJSON-1078994482 None] Terminate volume connection completed successfully. Sep 28 17:14:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-95c9ca57-ce53-4a6e-bca5-b540a21df8da req-9845bfd9-fd6a-426d-8a7f-4ae4a1f0dde9 tempest-AttachVolumeTestJSON-1078994482 None] Deleting attachment 5e27af7f-6e7a-47d3-a47d-065ef180b1b4. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:14:32 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-aea3eae3-bb29-4814-8e7b-3b5230563d85 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-quobyte-5ab2b42f-440e-4553-982c-3cee43f355a1" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:32 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-aea3eae3-bb29-4814-8e7b-3b5230563d85 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-5ab2b42f-440e-4553-982c-3cee43f355a1" acquired by "delete_volume" :: waited 0.026s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:32 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:32 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf1d25a-e699-4901-9a4b-b5b1fa55b517]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aea3eae3-bb29-4814-8e7b-3b5230563d85 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_asj4_e8pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f297417e-f577-4a3c-90d8-aac04a09f87d" returned: 0 in 3.100s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:32 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_asj4_e8pdevstack@QuobyteHD, size 112.00 MB, duration 3.11 sec, destination /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f297417e-f577-4a3c-90d8-aac04a09f87d {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:14:32 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Converted 112.00 MB image at 36.06 MB/s Sep 28 17:14:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f297417e-f577-4a3c-90d8-aac04a09f87d 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:32 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f297417e-f577-4a3c-90d8-aac04a09f87d 1G Sep 28 17:14:32 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dba4b72-22ae-4cf6-bad4-f848516f0612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '25f8a511-dfb2-473d-bb5f-2190aa84ee2a', 'volume_name': 'volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a', 'volume_size': 1, 'image_id': 'f0ffe98e-2982-4b8f-8d37-1cd5c0937b32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0ffe98e-2982-4b8f-8d37-1cd5c0937b32', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5ed33845ffc320ddbb22639cb66043da', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd56fcd35d80048f2b5f755b79f8d2a41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '24c51ce33700d7c8cb129f7777abed6d9ad023fdb9e0237b1b3847461c0031ae9429100495c7c6ff31a93b696d25eb1933d9ae072c572f3f95113b492ff5b07c', 'id': 'f0ffe98e-2982-4b8f-8d37-1cd5c0937b32', 'created_at': datetime.datetime(2026, 9, 28, 15, 14, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 14, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0ffe98e-2982-4b8f-8d37-1cd5c0937b32/file', 'properties': {}}, 'image_service': }' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:33 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1 Sep 28 17:14:33 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9ea5cd-40e5-461a-8992-169c2344a7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9ea5cd-40e5-461a-8992-169c2344a7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b93f69-e0c0-497a-924d-d27a3fea08e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:33 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Volume 25f8a511-dfb2-473d-bb5f-2190aa84ee2a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a', 'volume_size': 1, 'image_id': 'f0ffe98e-2982-4b8f-8d37-1cd5c0937b32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0ffe98e-2982-4b8f-8d37-1cd5c0937b32', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5ed33845ffc320ddbb22639cb66043da', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd56fcd35d80048f2b5f755b79f8d2a41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '24c51ce33700d7c8cb129f7777abed6d9ad023fdb9e0237b1b3847461c0031ae9429100495c7c6ff31a93b696d25eb1933d9ae072c572f3f95113b492ff5b07c', 'id': 'f0ffe98e-2982-4b8f-8d37-1cd5c0937b32', 'created_at': datetime.datetime(2026, 9, 28, 15, 14, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 14, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0ffe98e-2982-4b8f-8d37-1cd5c0937b32/file', 'properties': {}}, 'image_service': } Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Trying to clone 25f8a511-dfb2-473d-bb5f-2190aa84ee2a from image f0ffe98e-2982-4b8f-8d37-1cd5c0937b32 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f0ffe98e-2982-4b8f-8d37-1cd5c0937b32', 'metadata': {}}]). {{(pid=87061) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:14:33 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[71770d76-b402-4a54-946f-26698538f167]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:33 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f297417e-f577-4a3c-90d8-aac04a09f87d 1G" returned: 0 in 0.555s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Downloaded image 3da6edc3-4055-4154-be43-a897ff97d7cf ((None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}])) to volume f297417e-f577-4a3c-90d8-aac04a09f87d successfully. {{(pid=87061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Temporary image 3da6edc3-4055-4154-be43-a897ff97d7cf for user 2819d7ed92b34793956b001a87a2f252 is deleted. {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Marking volume f297417e-f577-4a3c-90d8-aac04a09f87d as bootable. {{(pid=87061) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:INSERT=43,cinder:UPDATE=186,cinder:SELECT=136,cinder:DELETE=12 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Copying metadata from image 3da6edc3-4055-4154-be43-a897ff97d7cf to f297417e-f577-4a3c-90d8-aac04a09f87d. {{(pid=87061) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Creating volume glance metadata for volume f297417e-f577-4a3c-90d8-aac04a09f87d backed by image 3da6edc3-4055-4154-be43-a897ff97d7cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87061) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=171,cinder:UPDATE=175,cinder:DELETE=18,cinder:INSERT=46 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:14:33 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aea3eae3-bb29-4814-8e7b-3b5230563d85 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1" returned: 0 in 0.679s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aea3eae3-bb29-4814-8e7b-3b5230563d85 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:33 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD Sep 28 17:14:33 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:33 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1 Sep 28 17:14:33 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b96965-a308-457c-b59a-b6e10811be9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f297417e-f577-4a3c-90d8-aac04a09f87d', 'volume_size': 1, 'image_id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21d27c6a4ac749c0a5b3cbd558b3b102', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'created_at': datetime.datetime(2026, 9, 28, 14, 57, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3da6edc3-4055-4154-be43-a897ff97d7cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039cbfc5-3712-4d9f-8357-d6c12efc6313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:33 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Volume volume-f297417e-f577-4a3c-90d8-aac04a09f87d (f297417e-f577-4a3c-90d8-aac04a09f87d): created successfully Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039cbfc5-3712-4d9f-8357-d6c12efc6313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Flow 'volume_create_manager' (bb3f0de5-9edb-4359-be09-763c9a9ce1d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:33 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-09f77db3-d09c-4df8-8a8f-5e31c15dd42c tempest-VolumesGetTest-661166036 None] Created volume successfully. Sep 28 17:14:33 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:33 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aea3eae3-bb29-4814-8e7b-3b5230563d85 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5ab2b42f-440e-4553-982c-3cee43f355a1" returned: 0 in 0.369s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-aea3eae3-bb29-4814-8e7b-3b5230563d85 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-5ab2b42f-440e-4553-982c-3cee43f355a1" released by "delete_volume" :: held 1.158s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:33 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD Sep 28 17:14:33 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:33 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-aea3eae3-bb29-4814-8e7b-3b5230563d85 tempest-VolumesSnapshotTestJSON-999222795 None] Created reservations ['e3116aa1-478e-4eca-a1e2-69765358de3c', '379a3a82-cac6-4043-a5e8-80b609853289', 'b69cc904-b6c8-4879-a321-3c9f97c4e7e5', '2055dd94-1805-4255-a500-b08167c32f0c'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-aea3eae3-bb29-4814-8e7b-3b5230563d85 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-aea3eae3-bb29-4814-8e7b-3b5230563d85 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-aea3eae3-bb29-4814-8e7b-3b5230563d85 tempest-VolumesSnapshotTestJSON-999222795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-aea3eae3-bb29-4814-8e7b-3b5230563d85 tempest-VolumesSnapshotTestJSON-999222795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-aea3eae3-bb29-4814-8e7b-3b5230563d85 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aea3eae3-bb29-4814-8e7b-3b5230563d85 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:34 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:14:34 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:34 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-6ab625e1-734e-453b-ad73-4d4a5fef7cf1 req-cb431bea-e8cf-4df2-8f56-7aad1172859f tempest-AttachVolumeTestJSON-1078994482 None] Terminate volume connection completed successfully. Sep 28 17:14:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-6ab625e1-734e-453b-ad73-4d4a5fef7cf1 req-cb431bea-e8cf-4df2-8f56-7aad1172859f tempest-AttachVolumeTestJSON-1078994482 None] Deleting attachment 6c7fd92a-35a4-4412-8a08-b1d8edfee15b. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:14:34 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD" returned: 1 in 0.412s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:14:34 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Temporary image f0ffe98e-2982-4b8f-8d37-1cd5c0937b32 is fetched for user 810b5a574c104f11815d29fa30f5bfac. {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:14:34 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cbf03c-f3f1-4f6a-90ef-f7a3416e7bc0]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:34 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aea3eae3-bb29-4814-8e7b-3b5230563d85 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.408s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:34 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-aea3eae3-bb29-4814-8e7b-3b5230563d85 tempest-VolumesSnapshotTestJSON-999222795 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:34 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-aea3eae3-bb29-4814-8e7b-3b5230563d85 tempest-VolumesSnapshotTestJSON-999222795 None] Deleted volume successfully. Sep 28 17:14:34 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD Sep 28 17:14:34 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:34 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-aea3eae3-bb29-4814-8e7b-3b5230563d85 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-5ab2b42f-440e-4553-982c-3cee43f355a1-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:34 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD" returned: 0 in 0.573s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:35 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD Sep 28 17:14:35 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:35 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD" returned: 1 in 0.521s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f8a511-dfb2-473d-bb5f-2190aa84ee2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d56fcd35d80048f2b5f755b79f8d2a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:32Z,use_quota=True,user_id='810b5a574c104f11815d29fa30f5bfac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Creating volume 25f8a511-dfb2-473d-bb5f-2190aa84ee2a {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:35 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:35 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a 1073741824 Sep 28 17:14:35 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Flow 'volume_create_manager' (40be5462-9d36-4fcf-b149-1cadc72846ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4840f9-c779-4c48-95dd-6b33f78f8277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4840f9-c779-4c48-95dd-6b33f78f8277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2042560119',display_name='tempest-VolumesGetTest-Volume-1716054368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36033e26-b0ea-45a0-9659-e8660656908b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47cfc0470734f5a9cf32d38abedcf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:36Z,use_quota=True,user_id='2819d7ed92b34793956b001a87a2f252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f0ea8c-2e34-4bfc-992b-818c4685121f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f0ea8c-2e34-4bfc-992b-818c4685121f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d6312a-c8e1-4c13-a2b7-c0da1ba05437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d6312a-c8e1-4c13-a2b7-c0da1ba05437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36033e26-b0ea-45a0-9659-e8660656908b', 'volume_name': 'volume-36033e26-b0ea-45a0-9659-e8660656908b', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f140ad57-c2e5-4351-8e97-8ad446bd2f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f140ad57-c2e5-4351-8e97-8ad446bd2f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9178b0e5-eb0a-41ce-9826-d90fd353ef5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:35 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Volume 36033e26-b0ea-45a0-9659-e8660656908b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36033e26-b0ea-45a0-9659-e8660656908b', 'volume_size': 1} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Flow 'volume_create_manager' (fba7c2cb-44b0-4dc8-986a-334a812f4aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3796a8e4-f811-49e9-9072-4f1fecd27566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3796a8e4-f811-49e9-9072-4f1fecd27566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-974303086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d42566-a0fd-4ae2-9dac-e0f7c6ece578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1597d278c62544538f0172cd1292f3dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:36Z,use_quota=True,user_id='e598fcac75cb44488aca25b98e029a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1fd78e-4154-4b89-9a2a-297cb7d4525e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1fd78e-4154-4b89-9a2a-297cb7d4525e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5fe911f-fd10-4037-9e5d-04f287ce260e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5fe911f-fd10-4037-9e5d-04f287ce260e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6d42566-a0fd-4ae2-9dac-e0f7c6ece578', 'volume_name': 'volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e4209d-8ec1-405b-bdca-f75253e0e215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e4209d-8ec1-405b-bdca-f75253e0e215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c48cdf-0a91-4a78-91e9-58ec7fba6ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:35 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Volume a6d42566-a0fd-4ae2-9dac-e0f7c6ece578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578', 'volume_size': 1} Sep 28 17:14:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:36 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a 1073741824" returned: 0 in 0.606s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:36 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a Sep 28 17:14:36 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:36 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a" returned: 0 in 0.300s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.556s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2042560119',display_name='tempest-VolumesGetTest-Volume-1716054368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36033e26-b0ea-45a0-9659-e8660656908b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47cfc0470734f5a9cf32d38abedcf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:36Z,use_quota=True,user_id='2819d7ed92b34793956b001a87a2f252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Creating volume 36033e26-b0ea-45a0-9659-e8660656908b {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:36 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:14:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-36033e26-b0ea-45a0-9659-e8660656908b 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:36 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-36033e26-b0ea-45a0-9659-e8660656908b 1073741824 Sep 28 17:14:36 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:36 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Attempting download of f0ffe98e-2982-4b8f-8d37-1cd5c0937b32 ((None, [{'url': 'file:///opt/stack/data/glance/images/f0ffe98e-2982-4b8f-8d37-1cd5c0937b32', 'metadata': {}}])) to volume 25f8a511-dfb2-473d-bb5f-2190aa84ee2a. {{(pid=87061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:14:36 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[51133a99-3d11-40b8-999b-28496c2240e6]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_5cwt_fca {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:36 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_5cwt_fca Sep 28 17:14:36 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:37 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_5cwt_fca" returned: 0 in 0.411s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_5cwt_fca {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:37 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-36033e26-b0ea-45a0-9659-e8660656908b 1073741824" returned: 0 in 0.667s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-36033e26-b0ea-45a0-9659-e8660656908b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:37 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_5cwt_fca Sep 28 17:14:37 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:37 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-36033e26-b0ea-45a0-9659-e8660656908b Sep 28 17:14:37 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:37 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_5cwt_fca" returned: 1 in 0.452s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_5cwt_fca' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9be4415-e57a-49b4-a52a-909c480a27c0]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:37 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-36033e26-b0ea-45a0-9659-e8660656908b" returned: 0 in 0.346s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.524s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-974303086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d42566-a0fd-4ae2-9dac-e0f7c6ece578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1597d278c62544538f0172cd1292f3dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:36Z,use_quota=True,user_id='e598fcac75cb44488aca25b98e029a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Creating volume a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:37 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:37 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 1073741824 Sep 28 17:14:37 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9178b0e5-eb0a-41ce-9826-d90fd353ef5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36033e26-b0ea-45a0-9659-e8660656908b', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071e6af0-c453-4dc7-84f1-482b6d97c073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:37 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Volume volume-36033e26-b0ea-45a0-9659-e8660656908b (36033e26-b0ea-45a0-9659-e8660656908b): created successfully Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071e6af0-c453-4dc7-84f1-482b6d97c073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Flow 'volume_create_manager' (40be5462-9d36-4fcf-b149-1cadc72846ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:37 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD Sep 28 17:14:37 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:37 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-4cdcc29a-68ab-444a-b9e3-7ed379944b3e tempest-VolumesGetTest-661166036 None] Created volume successfully. Sep 28 17:14:38 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3f2cc02c-2ad8-4c41-b60b-4d91ad6e68f9 tempest-VolumesGetTest-661166036 None] Acquiring lock "cinder-36033e26-b0ea-45a0-9659-e8660656908b-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD" returned: 0 in 0.664s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3f2cc02c-2ad8-4c41-b60b-4d91ad6e68f9 tempest-VolumesGetTest-661166036 None] Lock "cinder-36033e26-b0ea-45a0-9659-e8660656908b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3f2cc02c-2ad8-4c41-b60b-4d91ad6e68f9 tempest-VolumesGetTest-661166036 None] Acquiring lock "cinder-quobyte-36033e26-b0ea-45a0-9659-e8660656908b" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3f2cc02c-2ad8-4c41-b60b-4d91ad6e68f9 tempest-VolumesGetTest-661166036 None] Lock "cinder-quobyte-36033e26-b0ea-45a0-9659-e8660656908b" acquired by "delete_volume" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:38 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a680e757-2c74-4a0f-9ed2-6031e3f9cd92]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3f2cc02c-2ad8-4c41-b60b-4d91ad6e68f9 tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-36033e26-b0ea-45a0-9659-e8660656908b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:38 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 1073741824" returned: 0 in 0.788s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:38 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD Sep 28 17:14:38 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:38 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 Sep 28 17:14:38 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:38 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-36033e26-b0ea-45a0-9659-e8660656908b Sep 28 17:14:38 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:38 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD" returned: 1 in 0.529s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:14:38 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] f0ffe98e-2982-4b8f-8d37-1cd5c0937b32 was raw, converting to qcow2 {{(pid=87061) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:14:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:38 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a Sep 28 17:14:38 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:38 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578" returned: 0 in 0.419s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c48cdf-0a91-4a78-91e9-58ec7fba6ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540097e2-5deb-4044-842e-931692e6191c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:38 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Volume volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 (a6d42566-a0fd-4ae2-9dac-e0f7c6ece578): created successfully Sep 28 17:14:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540097e2-5deb-4044-842e-931692e6191c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Flow 'volume_create_manager' (fba7c2cb-44b0-4dc8-986a-334a812f4aa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:38 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-048f7436-f7c0-491e-afa8-41d63c684993 tempest-VolumesSnapshotTestJSON-999222795 None] Created volume successfully. Sep 28 17:14:39 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3f2cc02c-2ad8-4c41-b60b-4d91ad6e68f9 tempest-VolumesGetTest-661166036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-36033e26-b0ea-45a0-9659-e8660656908b" returned: 0 in 0.746s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3f2cc02c-2ad8-4c41-b60b-4d91ad6e68f9 tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-36033e26-b0ea-45a0-9659-e8660656908b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:39 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-36033e26-b0ea-45a0-9659-e8660656908b Sep 28 17:14:39 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:39 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3f2cc02c-2ad8-4c41-b60b-4d91ad6e68f9 tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-36033e26-b0ea-45a0-9659-e8660656908b" returned: 0 in 0.307s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3f2cc02c-2ad8-4c41-b60b-4d91ad6e68f9 tempest-VolumesGetTest-661166036 None] Lock "cinder-quobyte-36033e26-b0ea-45a0-9659-e8660656908b" released by "delete_volume" :: held 1.113s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:39 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:39 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-3f2cc02c-2ad8-4c41-b60b-4d91ad6e68f9 tempest-VolumesGetTest-661166036 None] Created reservations ['4e22c91b-4dd7-4c52-8a86-27297973e2ca', '0a1d9558-3676-4753-b3ef-edfbc82f041d', '2ef3bb7e-605c-4e7b-81cd-87bfc1b068a2', '7d507d91-9765-4c9f-a638-43d83cabfbbe'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a" returned: 0 in 0.746s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:39 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f0ffe98e-2982-4b8f-8d37-1cd5c0937b32_c7o8b3azdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:14:39 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:14:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:39 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a 1G Sep 28 17:14:39 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3f2cc02c-2ad8-4c41-b60b-4d91ad6e68f9 tempest-VolumesGetTest-661166036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3f2cc02c-2ad8-4c41-b60b-4d91ad6e68f9 tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3f2cc02c-2ad8-4c41-b60b-4d91ad6e68f9 tempest-VolumesGetTest-661166036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3f2cc02c-2ad8-4c41-b60b-4d91ad6e68f9 tempest-VolumesGetTest-661166036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3f2cc02c-2ad8-4c41-b60b-4d91ad6e68f9 tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3f2cc02c-2ad8-4c41-b60b-4d91ad6e68f9 tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:39 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:14:39 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2afde98e-7373-4985-ab68-b1fa4c61e9ec tempest-VolumesGetTest-661166036 None] Acquiring lock "cinder-f297417e-f577-4a3c-90d8-aac04a09f87d-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2afde98e-7373-4985-ab68-b1fa4c61e9ec tempest-VolumesGetTest-661166036 None] Lock "cinder-f297417e-f577-4a3c-90d8-aac04a09f87d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2afde98e-7373-4985-ab68-b1fa4c61e9ec tempest-VolumesGetTest-661166036 None] Acquiring lock "cinder-quobyte-f297417e-f577-4a3c-90d8-aac04a09f87d" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2afde98e-7373-4985-ab68-b1fa4c61e9ec tempest-VolumesGetTest-661166036 None] Lock "cinder-quobyte-f297417e-f577-4a3c-90d8-aac04a09f87d" acquired by "delete_volume" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:39 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba78208-3294-41e8-85f9-3d2399a6b55a]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:39 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2afde98e-7373-4985-ab68-b1fa4c61e9ec tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f297417e-f577-4a3c-90d8-aac04a09f87d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3f2cc02c-2ad8-4c41-b60b-4d91ad6e68f9 tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.386s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:39 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-3f2cc02c-2ad8-4c41-b60b-4d91ad6e68f9 tempest-VolumesGetTest-661166036 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:39 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-3f2cc02c-2ad8-4c41-b60b-4d91ad6e68f9 tempest-VolumesGetTest-661166036 None] Deleted volume successfully. Sep 28 17:14:39 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a 1G" returned: 0 in 0.543s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Downloaded image f0ffe98e-2982-4b8f-8d37-1cd5c0937b32 ((None, [{'url': 'file:///opt/stack/data/glance/images/f0ffe98e-2982-4b8f-8d37-1cd5c0937b32', 'metadata': {}}])) to volume 25f8a511-dfb2-473d-bb5f-2190aa84ee2a successfully. {{(pid=87061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Temporary image f0ffe98e-2982-4b8f-8d37-1cd5c0937b32 for user 810b5a574c104f11815d29fa30f5bfac is deleted. {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Marking volume 25f8a511-dfb2-473d-bb5f-2190aa84ee2a as bootable. {{(pid=87061) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3f2cc02c-2ad8-4c41-b60b-4d91ad6e68f9 tempest-VolumesGetTest-661166036 None] Lock "cinder-36033e26-b0ea-45a0-9659-e8660656908b-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Copying metadata from image f0ffe98e-2982-4b8f-8d37-1cd5c0937b32 to 25f8a511-dfb2-473d-bb5f-2190aa84ee2a. {{(pid=87061) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Creating volume glance metadata for volume 25f8a511-dfb2-473d-bb5f-2190aa84ee2a backed by image f0ffe98e-2982-4b8f-8d37-1cd5c0937b32 with: {'image_id': 'f0ffe98e-2982-4b8f-8d37-1cd5c0937b32', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5ed33845ffc320ddbb22639cb66043da', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87061) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:14:40 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f297417e-f577-4a3c-90d8-aac04a09f87d Sep 28 17:14:40 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b93f69-e0c0-497a-924d-d27a3fea08e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a', 'volume_size': 1, 'image_id': 'f0ffe98e-2982-4b8f-8d37-1cd5c0937b32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0ffe98e-2982-4b8f-8d37-1cd5c0937b32', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5ed33845ffc320ddbb22639cb66043da', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd56fcd35d80048f2b5f755b79f8d2a41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '24c51ce33700d7c8cb129f7777abed6d9ad023fdb9e0237b1b3847461c0031ae9429100495c7c6ff31a93b696d25eb1933d9ae072c572f3f95113b492ff5b07c', 'id': 'f0ffe98e-2982-4b8f-8d37-1cd5c0937b32', 'created_at': datetime.datetime(2026, 9, 28, 15, 14, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 14, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0ffe98e-2982-4b8f-8d37-1cd5c0937b32/file', 'properties': {}}, 'image_service': }' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f639a29d-575d-432f-9fb0-f2e943cc8267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:40 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Volume volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a (25f8a511-dfb2-473d-bb5f-2190aa84ee2a): created successfully Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f639a29d-575d-432f-9fb0-f2e943cc8267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Flow 'volume_create_manager' (1076e9e6-2f7e-4bb7-88c0-8a85d233f2d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:40 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-9a31214c-80cc-43fa-bfe1-837e821fb55d tempest-VolumeImageDependencyTests-1968293481 None] Created volume successfully. Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a02e08ec-c461-4487-9594-7132690d9077 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a02e08ec-c461-4487-9594-7132690d9077 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-a02e08ec-c461-4487-9594-7132690d9077 tempest-VolumesSnapshotTestJSON-999222795 None] Creating offline snapshot 419d2703-a714-4710-9899-e97834deb6c0 of volume a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c163e8c-a0df-495f-90aa-39b0118fcff7]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a02e08ec-c461-4487-9594-7132690d9077 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:40 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2afde98e-7373-4985-ab68-b1fa4c61e9ec tempest-VolumesGetTest-661166036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f297417e-f577-4a3c-90d8-aac04a09f87d" returned: 0 in 0.620s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2afde98e-7373-4985-ab68-b1fa4c61e9ec tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f297417e-f577-4a3c-90d8-aac04a09f87d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:40 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f297417e-f577-4a3c-90d8-aac04a09f87d Sep 28 17:14:40 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:40 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 Sep 28 17:14:40 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:40 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2afde98e-7373-4985-ab68-b1fa4c61e9ec tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f297417e-f577-4a3c-90d8-aac04a09f87d" returned: 0 in 0.333s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2afde98e-7373-4985-ab68-b1fa4c61e9ec tempest-VolumesGetTest-661166036 None] Lock "cinder-quobyte-f297417e-f577-4a3c-90d8-aac04a09f87d" released by "delete_volume" :: held 1.012s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:40 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a02e08ec-c461-4487-9594-7132690d9077 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578" returned: 0 in 0.504s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a02e08ec-c461-4487-9594-7132690d9077 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:40 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-2afde98e-7373-4985-ab68-b1fa4c61e9ec tempest-VolumesGetTest-661166036 None] Created reservations ['7f76f509-b2ab-4c1d-9605-85f44abe56eb', '889a3f0a-e8c6-4167-adc2-a7632baadc76', '50ed810f-0e94-422f-a05f-eac04452ba9d', '55f5fe4a-a328-4854-a502-54c4b3155e7e'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:41 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0 1G Sep 28 17:14:41 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2afde98e-7373-4985-ab68-b1fa4c61e9ec tempest-VolumesGetTest-661166036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2afde98e-7373-4985-ab68-b1fa4c61e9ec tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2afde98e-7373-4985-ab68-b1fa4c61e9ec tempest-VolumesGetTest-661166036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2afde98e-7373-4985-ab68-b1fa4c61e9ec tempest-VolumesGetTest-661166036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2afde98e-7373-4985-ab68-b1fa4c61e9ec tempest-VolumesGetTest-661166036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2afde98e-7373-4985-ab68-b1fa4c61e9ec tempest-VolumesGetTest-661166036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:41 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:14:41 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1c4244e9-2a86-4b9e-b1ab-59a429091890 tempest-VolumeImageDependencyTests-1968293481 None] Acquiring lock "cinder-25f8a511-dfb2-473d-bb5f-2190aa84ee2a-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7b802741-cb04-4dc3-81c2-5df7123c2fe1 tempest-AttachVolumeTestJSON-1078994482 None] Acquiring lock "cinder-ba5bc539-e2c6-4f56-b9d1-91f6d7708599-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1c4244e9-2a86-4b9e-b1ab-59a429091890 tempest-VolumeImageDependencyTests-1968293481 None] Lock "cinder-25f8a511-dfb2-473d-bb5f-2190aa84ee2a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7b802741-cb04-4dc3-81c2-5df7123c2fe1 tempest-AttachVolumeTestJSON-1078994482 None] Lock "cinder-ba5bc539-e2c6-4f56-b9d1-91f6d7708599-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:41 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2afde98e-7373-4985-ab68-b1fa4c61e9ec tempest-VolumesGetTest-661166036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.412s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7b802741-cb04-4dc3-81c2-5df7123c2fe1 tempest-AttachVolumeTestJSON-1078994482 None] Acquiring lock "cinder-quobyte-ba5bc539-e2c6-4f56-b9d1-91f6d7708599" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-2afde98e-7373-4985-ab68-b1fa4c61e9ec tempest-VolumesGetTest-661166036 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1c4244e9-2a86-4b9e-b1ab-59a429091890 tempest-VolumeImageDependencyTests-1968293481 None] Acquiring lock "cinder-quobyte-25f8a511-dfb2-473d-bb5f-2190aa84ee2a" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:41 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-2afde98e-7373-4985-ab68-b1fa4c61e9ec tempest-VolumesGetTest-661166036 None] Deleted volume successfully. Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7b802741-cb04-4dc3-81c2-5df7123c2fe1 tempest-AttachVolumeTestJSON-1078994482 None] Lock "cinder-quobyte-ba5bc539-e2c6-4f56-b9d1-91f6d7708599" acquired by "delete_volume" :: waited 0.050s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1c4244e9-2a86-4b9e-b1ab-59a429091890 tempest-VolumeImageDependencyTests-1968293481 None] Lock "cinder-quobyte-25f8a511-dfb2-473d-bb5f-2190aa84ee2a" acquired by "delete_volume" :: waited 0.075s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2afde98e-7373-4985-ab68-b1fa4c61e9ec tempest-VolumesGetTest-661166036 None] Lock "cinder-f297417e-f577-4a3c-90d8-aac04a09f87d-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb859092-d764-4536-b988-552445f1b7f1]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7b802741-cb04-4dc3-81c2-5df7123c2fe1 tempest-AttachVolumeTestJSON-1078994482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ba5bc539-e2c6-4f56-b9d1-91f6d7708599 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[4544527c-b999-4717-81d2-dfe44308c286]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c4244e9-2a86-4b9e-b1ab-59a429091890 tempest-VolumeImageDependencyTests-1968293481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:41 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a02e08ec-c461-4487-9594-7132690d9077 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0 1G" returned: 0 in 0.723s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a02e08ec-c461-4487-9594-7132690d9077 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:41 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0 Sep 28 17:14:41 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:41 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ba5bc539-e2c6-4f56-b9d1-91f6d7708599 Sep 28 17:14:41 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:41 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a Sep 28 17:14:41 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:42 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a02e08ec-c461-4487-9594-7132690d9077 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0" returned: 0 in 0.418s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:42 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-a02e08ec-c461-4487-9594-7132690d9077 tempest-VolumesSnapshotTestJSON-999222795 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0 is being set with open permissions: ugo+rw Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a02e08ec-c461-4487-9594-7132690d9077 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:42 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7b802741-cb04-4dc3-81c2-5df7123c2fe1 tempest-AttachVolumeTestJSON-1078994482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ba5bc539-e2c6-4f56-b9d1-91f6d7708599" returned: 0 in 0.487s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7b802741-cb04-4dc3-81c2-5df7123c2fe1 tempest-AttachVolumeTestJSON-1078994482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ba5bc539-e2c6-4f56-b9d1-91f6d7708599 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:42 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:42 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0 Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c4244e9-2a86-4b9e-b1ab-59a429091890 tempest-VolumeImageDependencyTests-1968293481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a" returned: 0 in 0.476s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:42 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c4244e9-2a86-4b9e-b1ab-59a429091890 tempest-VolumeImageDependencyTests-1968293481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:42 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ba5bc539-e2c6-4f56-b9d1-91f6d7708599 Sep 28 17:14:42 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:42 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a Sep 28 17:14:42 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:42 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a02e08ec-c461-4487-9594-7132690d9077 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0" returned: 0 in 0.369s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:42 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a02e08ec-c461-4487-9594-7132690d9077 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7b802741-cb04-4dc3-81c2-5df7123c2fe1 tempest-AttachVolumeTestJSON-1078994482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ba5bc539-e2c6-4f56-b9d1-91f6d7708599" returned: 0 in 0.405s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:42 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.info Sep 28 17:14:42 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7b802741-cb04-4dc3-81c2-5df7123c2fe1 tempest-AttachVolumeTestJSON-1078994482 None] Lock "cinder-quobyte-ba5bc539-e2c6-4f56-b9d1-91f6d7708599" released by "delete_volume" :: held 1.001s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:42 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c4244e9-2a86-4b9e-b1ab-59a429091890 tempest-VolumeImageDependencyTests-1968293481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25f8a511-dfb2-473d-bb5f-2190aa84ee2a" returned: 0 in 0.509s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1c4244e9-2a86-4b9e-b1ab-59a429091890 tempest-VolumeImageDependencyTests-1968293481 None] Lock "cinder-quobyte-25f8a511-dfb2-473d-bb5f-2190aa84ee2a" released by "delete_volume" :: held 1.062s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-7b802741-cb04-4dc3-81c2-5df7123c2fe1 tempest-AttachVolumeTestJSON-1078994482 None] Created reservations ['19ee6314-56cd-41e8-850c-ce6be327d6b8', '15923156-28cb-4f7b-8a20-f9b0a62632a2', 'ac6cd17c-b584-4161-9c02-03a2ff829f89', '198db45a-c7aa-47c6-953e-30fe74b6f5aa'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-1c4244e9-2a86-4b9e-b1ab-59a429091890 tempest-VolumeImageDependencyTests-1968293481 None] Created reservations ['d9e184e3-4f3d-4d56-9c5c-ab3cf8deed59', 'da9b42bd-cf11-4459-96b3-8c9fa145a8a5', '7391b0ef-9955-4544-a289-1038f41e4893', '14cbe4fc-26f4-4631-88c1-162dac2b1dfe'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7b802741-cb04-4dc3-81c2-5df7123c2fe1 tempest-AttachVolumeTestJSON-1078994482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7b802741-cb04-4dc3-81c2-5df7123c2fe1 tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7b802741-cb04-4dc3-81c2-5df7123c2fe1 tempest-AttachVolumeTestJSON-1078994482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7b802741-cb04-4dc3-81c2-5df7123c2fe1 tempest-AttachVolumeTestJSON-1078994482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7b802741-cb04-4dc3-81c2-5df7123c2fe1 tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7b802741-cb04-4dc3-81c2-5df7123c2fe1 tempest-AttachVolumeTestJSON-1078994482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:42 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:14:42 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1c4244e9-2a86-4b9e-b1ab-59a429091890 tempest-VolumeImageDependencyTests-1968293481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1c4244e9-2a86-4b9e-b1ab-59a429091890 tempest-VolumeImageDependencyTests-1968293481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1c4244e9-2a86-4b9e-b1ab-59a429091890 tempest-VolumeImageDependencyTests-1968293481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:42 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1c4244e9-2a86-4b9e-b1ab-59a429091890 tempest-VolumeImageDependencyTests-1968293481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1c4244e9-2a86-4b9e-b1ab-59a429091890 tempest-VolumeImageDependencyTests-1968293481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c4244e9-2a86-4b9e-b1ab-59a429091890 tempest-VolumeImageDependencyTests-1968293481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a02e08ec-c461-4487-9594-7132690d9077 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.info" returned: 0 in 0.413s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:42 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-a02e08ec-c461-4487-9594-7132690d9077 tempest-VolumesSnapshotTestJSON-999222795 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.info is being set with open permissions: ugo+rw Sep 28 17:14:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a02e08ec-c461-4487-9594-7132690d9077 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:42 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:14:42 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:42 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.info Sep 28 17:14:42 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:43 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7b802741-cb04-4dc3-81c2-5df7123c2fe1 tempest-AttachVolumeTestJSON-1078994482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.420s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:43 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-7b802741-cb04-4dc3-81c2-5df7123c2fe1 tempest-AttachVolumeTestJSON-1078994482 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:43 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-7b802741-cb04-4dc3-81c2-5df7123c2fe1 tempest-AttachVolumeTestJSON-1078994482 None] Deleted volume successfully. Sep 28 17:14:43 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7b802741-cb04-4dc3-81c2-5df7123c2fe1 tempest-AttachVolumeTestJSON-1078994482 None] Lock "cinder-ba5bc539-e2c6-4f56-b9d1-91f6d7708599-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a02e08ec-c461-4487-9594-7132690d9077 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.info" returned: 0 in 0.406s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a02e08ec-c461-4487-9594-7132690d9077 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.964s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:43 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c4244e9-2a86-4b9e-b1ab-59a429091890 tempest-VolumeImageDependencyTests-1968293481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.456s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:43 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1c4244e9-2a86-4b9e-b1ab-59a429091890 tempest-VolumeImageDependencyTests-1968293481 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:43 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-1c4244e9-2a86-4b9e-b1ab-59a429091890 tempest-VolumeImageDependencyTests-1968293481 None] Deleted volume successfully. Sep 28 17:14:43 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a02e08ec-c461-4487-9594-7132690d9077 tempest-VolumesSnapshotTestJSON-999222795 None] Create snapshot completed successfully Sep 28 17:14:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1c4244e9-2a86-4b9e-b1ab-59a429091890 tempest-VolumeImageDependencyTests-1968293481 None] Lock "cinder-25f8a511-dfb2-473d-bb5f-2190aa84ee2a-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-53f7c03d-7c64-4070-bac9-8ff501b24f71 tempest-AttachVolumeTestJSON-1078994482 None] Acquiring lock "cinder-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-53f7c03d-7c64-4070-bac9-8ff501b24f71 tempest-AttachVolumeTestJSON-1078994482 None] Lock "cinder-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-53f7c03d-7c64-4070-bac9-8ff501b24f71 tempest-AttachVolumeTestJSON-1078994482 None] Acquiring lock "cinder-quobyte-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-53f7c03d-7c64-4070-bac9-8ff501b24f71 tempest-AttachVolumeTestJSON-1078994482 None] Lock "cinder-quobyte-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb" acquired by "delete_volume" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b98668-74da-4b44-ae8c-c5a082a33fef]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-53f7c03d-7c64-4070-bac9-8ff501b24f71 tempest-AttachVolumeTestJSON-1078994482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:44 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb Sep 28 17:14:44 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:44 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-53f7c03d-7c64-4070-bac9-8ff501b24f71 tempest-AttachVolumeTestJSON-1078994482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb" returned: 0 in 0.587s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-53f7c03d-7c64-4070-bac9-8ff501b24f71 tempest-AttachVolumeTestJSON-1078994482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:44 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb Sep 28 17:14:44 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Flow 'volume_create_manager' (51b7953d-646c-4821-bc36-b5716f177242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233639b5-95be-405e-9482-0654024f50e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233639b5-95be-405e-9482-0654024f50e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-760411035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2659d942-849e-47c9-b07d-a4eec8c657ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1597d278c62544538f0172cd1292f3dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=419d2703-a714-4710-9899-e97834deb6c0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:45Z,use_quota=True,user_id='e598fcac75cb44488aca25b98e029a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e5f521-219f-41c2-abb6-9af271814809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e5f521-219f-41c2-abb6-9af271814809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aaa5294-8f2a-4542-b764-6a6ab2685bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aaa5294-8f2a-4542-b764-6a6ab2685bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2659d942-849e-47c9-b07d-a4eec8c657ff', 'volume_name': 'volume-2659d942-849e-47c9-b07d-a4eec8c657ff', 'volume_size': 1, 'snapshot_id': '419d2703-a714-4710-9899-e97834deb6c0'}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8beed05b-e1e5-4337-a905-c17e70d923dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8beed05b-e1e5-4337-a905-c17e70d923dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4906cd07-ab6b-4bb0-b873-e4a767b84d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:44 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Volume 2659d942-849e-47c9-b07d-a4eec8c657ff: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2659d942-849e-47c9-b07d-a4eec8c657ff', 'volume_size': 1, 'snapshot_id': '419d2703-a714-4710-9899-e97834deb6c0'} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-quobyte-419d2703-a714-4710-9899-e97834deb6c0-2659d942-849e-47c9-b07d-a4eec8c657ff" by "_create_volume_from_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-419d2703-a714-4710-9899-e97834deb6c0-2659d942-849e-47c9-b07d-a4eec8c657ff" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Creating volume 2659d942-849e-47c9-b07d-a4eec8c657ff from snapshot 419d2703-a714-4710-9899-e97834deb6c0 {{(pid=87061) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:45 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-quobyte-2659d942-849e-47c9-b07d-a4eec8c657ff" by "_copy_volume_from_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:45 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-2659d942-849e-47c9-b07d-a4eec8c657ff" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] snapshot: 419d2703-a714-4710-9899-e97834deb6c0, volume: 2659d942-849e-47c9-b07d-a4eec8c657ff, {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:14:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:45 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-53f7c03d-7c64-4070-bac9-8ff501b24f71 tempest-AttachVolumeTestJSON-1078994482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb" returned: 0 in 0.460s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:45 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[32700555-5d6e-4b5e-b21a-56a78cb5a41e]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:45 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-53f7c03d-7c64-4070-bac9-8ff501b24f71 tempest-AttachVolumeTestJSON-1078994482 None] Lock "cinder-quobyte-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb" released by "delete_volume" :: held 1.142s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:45 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-53f7c03d-7c64-4070-bac9-8ff501b24f71 tempest-AttachVolumeTestJSON-1078994482 None] Created reservations ['cfb9150b-372f-4393-8c2d-99585ee5625c', 'e94bddc0-4820-4efa-89e6-0a9c3f535cac', 'f3916761-bacf-4b86-8cba-5029a8ea5bf2', 'e330d09a-7f71-45a5-9c64-baa6c6e3aa27'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:45 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0 Sep 28 17:14:45 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-53f7c03d-7c64-4070-bac9-8ff501b24f71 tempest-AttachVolumeTestJSON-1078994482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-53f7c03d-7c64-4070-bac9-8ff501b24f71 tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-53f7c03d-7c64-4070-bac9-8ff501b24f71 tempest-AttachVolumeTestJSON-1078994482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-53f7c03d-7c64-4070-bac9-8ff501b24f71 tempest-AttachVolumeTestJSON-1078994482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-53f7c03d-7c64-4070-bac9-8ff501b24f71 tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-53f7c03d-7c64-4070-bac9-8ff501b24f71 tempest-AttachVolumeTestJSON-1078994482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:45 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:14:45 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:45 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-53f7c03d-7c64-4070-bac9-8ff501b24f71 tempest-AttachVolumeTestJSON-1078994482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.481s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:46 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-53f7c03d-7c64-4070-bac9-8ff501b24f71 tempest-AttachVolumeTestJSON-1078994482 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:46 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-53f7c03d-7c64-4070-bac9-8ff501b24f71 tempest-AttachVolumeTestJSON-1078994482 None] Deleted volume successfully. Sep 28 17:14:46 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-53f7c03d-7c64-4070-bac9-8ff501b24f71 tempest-AttachVolumeTestJSON-1078994482 None] Lock "cinder-40ac12a1-8fcc-4330-abf7-219f2fc5dbeb-delete_volume" released by "delete_volume" :: held 2.110s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0" returned: 0 in 0.914s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:46 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:46 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc5c6b5-2321-44d5-987a-777251875a11]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:46 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 Sep 28 17:14:46 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:46 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-56b26c7b-57d5-477b-8379-045bec1af930 tempest-AttachVolumeTestJSON-1078994482 None] Acquiring lock "cinder-1fb52734-11dc-43ef-b773-45fe688b1e7d-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:46 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-56b26c7b-57d5-477b-8379-045bec1af930 tempest-AttachVolumeTestJSON-1078994482 None] Lock "cinder-1fb52734-11dc-43ef-b773-45fe688b1e7d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:46 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-56b26c7b-57d5-477b-8379-045bec1af930 tempest-AttachVolumeTestJSON-1078994482 None] Acquiring lock "cinder-quobyte-1fb52734-11dc-43ef-b773-45fe688b1e7d" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:46 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-56b26c7b-57d5-477b-8379-045bec1af930 tempest-AttachVolumeTestJSON-1078994482 None] Lock "cinder-quobyte-1fb52734-11dc-43ef-b773-45fe688b1e7d" acquired by "delete_volume" :: waited 0.034s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:46 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10dac58-140a-44d8-8117-8039eeb0fd45]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-56b26c7b-57d5-477b-8379-045bec1af930 tempest-AttachVolumeTestJSON-1078994482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1fb52734-11dc-43ef-b773-45fe688b1e7d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:46 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578" returned: 0 in 0.696s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:14:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Creating direct copy from snapshot {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:14:46 devstack cinder-volume[87061]: DEBUG cinder.utils [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Path /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2659d942-849e-47c9-b07d-a4eec8c657ff not found in is_blk_device check {{(pid=87061) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:14:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2659d942-849e-47c9-b07d-a4eec8c657ff {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:46 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2659d942-849e-47c9-b07d-a4eec8c657ff Sep 28 17:14:46 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:46 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1fb52734-11dc-43ef-b773-45fe688b1e7d Sep 28 17:14:46 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:47 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-56b26c7b-57d5-477b-8379-045bec1af930 tempest-AttachVolumeTestJSON-1078994482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1fb52734-11dc-43ef-b773-45fe688b1e7d" returned: 0 in 0.593s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-56b26c7b-57d5-477b-8379-045bec1af930 tempest-AttachVolumeTestJSON-1078994482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1fb52734-11dc-43ef-b773-45fe688b1e7d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:47 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1fb52734-11dc-43ef-b773-45fe688b1e7d Sep 28 17:14:47 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:47 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-56b26c7b-57d5-477b-8379-045bec1af930 tempest-AttachVolumeTestJSON-1078994482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1fb52734-11dc-43ef-b773-45fe688b1e7d" returned: 0 in 0.480s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-56b26c7b-57d5-477b-8379-045bec1af930 tempest-AttachVolumeTestJSON-1078994482 None] Lock "cinder-quobyte-1fb52734-11dc-43ef-b773-45fe688b1e7d" released by "delete_volume" :: held 1.175s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:47 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-56b26c7b-57d5-477b-8379-045bec1af930 tempest-AttachVolumeTestJSON-1078994482 None] Created reservations ['903a4c88-c737-4120-913c-50fc38bc3e98', 'f2ccdff0-320f-4e94-abcc-d6c1bf9ff38c', 'c18df0a6-670d-4d56-812c-863fbcd16d7d', 'abe56207-41c9-4376-9dd7-54cd0590917a'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-56b26c7b-57d5-477b-8379-045bec1af930 tempest-AttachVolumeTestJSON-1078994482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-56b26c7b-57d5-477b-8379-045bec1af930 tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:48 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-56b26c7b-57d5-477b-8379-045bec1af930 tempest-AttachVolumeTestJSON-1078994482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:48 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-56b26c7b-57d5-477b-8379-045bec1af930 tempest-AttachVolumeTestJSON-1078994482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-56b26c7b-57d5-477b-8379-045bec1af930 tempest-AttachVolumeTestJSON-1078994482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-56b26c7b-57d5-477b-8379-045bec1af930 tempest-AttachVolumeTestJSON-1078994482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:48 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:14:48 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:48 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-56b26c7b-57d5-477b-8379-045bec1af930 tempest-AttachVolumeTestJSON-1078994482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.823s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:49 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-56b26c7b-57d5-477b-8379-045bec1af930 tempest-AttachVolumeTestJSON-1078994482 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:49 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-56b26c7b-57d5-477b-8379-045bec1af930 tempest-AttachVolumeTestJSON-1078994482 None] Deleted volume successfully. Sep 28 17:14:49 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-56b26c7b-57d5-477b-8379-045bec1af930 tempest-AttachVolumeTestJSON-1078994482 None] Lock "cinder-1fb52734-11dc-43ef-b773-45fe688b1e7d-delete_volume" released by "delete_volume" :: held 2.528s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:55 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2659d942-849e-47c9-b07d-a4eec8c657ff" returned: 0 in 9.170s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:55 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Image conversion details: src /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578, size 1024.00 MB, duration 9.17 sec, destination /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2659d942-849e-47c9-b07d-a4eec8c657ff {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:14:55 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Converted 1024.00 MB image at 111.66 MB/s Sep 28 17:14:55 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2659d942-849e-47c9-b07d-a4eec8c657ff is being set with open permissions: ugo+rw Sep 28 17:14:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2659d942-849e-47c9-b07d-a4eec8c657ff {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:56 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2659d942-849e-47c9-b07d-a4eec8c657ff Sep 28 17:14:56 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:56 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2659d942-849e-47c9-b07d-a4eec8c657ff" returned: 0 in 0.320s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:56 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-2659d942-849e-47c9-b07d-a4eec8c657ff" released by "_copy_volume_from_snapshot" :: held 11.281s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:56 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-419d2703-a714-4710-9899-e97834deb6c0-2659d942-849e-47c9-b07d-a4eec8c657ff" released by "_create_volume_from_snapshot" :: held 11.416s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.450s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4906cd07-ab6b-4bb0-b873-e4a767b84d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2659d942-849e-47c9-b07d-a4eec8c657ff', 'volume_size': 1, 'snapshot_id': '419d2703-a714-4710-9899-e97834deb6c0'}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf6501d-6766-4182-9574-ad1a60c4446e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:56 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Volume volume-2659d942-849e-47c9-b07d-a4eec8c657ff (2659d942-849e-47c9-b07d-a4eec8c657ff): created successfully Sep 28 17:14:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf6501d-6766-4182-9574-ad1a60c4446e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Flow 'volume_create_manager' (51b7953d-646c-4821-bc36-b5716f177242) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:56 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-fd044494-4628-40f3-8ff6-3a1b2c14c178 tempest-VolumesSnapshotTestJSON-999222795 None] Created volume successfully. Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Flow 'volume_create_manager' (11f61722-2b9a-4269-b453-f0742f700b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c447fbf2-0940-4c0d-94a6-dfb110451209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c447fbf2-0940-4c0d-94a6-dfb110451209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2035645976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=582f93fe-d4af-43ea-b820-cdf29ce6c2df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b3acaafd9e84defa885c255b35e3b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:57Z,use_quota=True,user_id='4b1367522faa492f8b0e36133d42b5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39aeb5b9-fb30-4cbb-8022-691e34e1420e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39aeb5b9-fb30-4cbb-8022-691e34e1420e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc0e97f-7df5-4543-ba3b-9ff503d2c688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc0e97f-7df5-4543-ba3b-9ff503d2c688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '582f93fe-d4af-43ea-b820-cdf29ce6c2df', 'volume_name': 'volume-582f93fe-d4af-43ea-b820-cdf29ce6c2df', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2b0d69-16ad-44ad-a293-ef298dc9b27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2b0d69-16ad-44ad-a293-ef298dc9b27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f98c1866-a236-4d9d-9602-b16182b6c2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:57 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Volume 582f93fe-d4af-43ea-b820-cdf29ce6c2df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-582f93fe-d4af-43ea-b820-cdf29ce6c2df', 'volume_size': 1} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2035645976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=582f93fe-d4af-43ea-b820-cdf29ce6c2df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b3acaafd9e84defa885c255b35e3b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:57Z,use_quota=True,user_id='4b1367522faa492f8b0e36133d42b5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Creating volume 582f93fe-d4af-43ea-b820-cdf29ce6c2df {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:57 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-582f93fe-d4af-43ea-b820-cdf29ce6c2df 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:57 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-582f93fe-d4af-43ea-b820-cdf29ce6c2df 1073741824 Sep 28 17:14:57 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-57012ac5-af0e-4c12-a41b-06485acad485 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-2659d942-849e-47c9-b07d-a4eec8c657ff-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-57012ac5-af0e-4c12-a41b-06485acad485 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-2659d942-849e-47c9-b07d-a4eec8c657ff-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-57012ac5-af0e-4c12-a41b-06485acad485 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-quobyte-2659d942-849e-47c9-b07d-a4eec8c657ff" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-57012ac5-af0e-4c12-a41b-06485acad485 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-2659d942-849e-47c9-b07d-a4eec8c657ff" acquired by "delete_volume" :: waited 0.026s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1565296-410e-47a2-b94c-06c0b4c035aa]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57012ac5-af0e-4c12-a41b-06485acad485 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2659d942-849e-47c9-b07d-a4eec8c657ff {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:58 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2659d942-849e-47c9-b07d-a4eec8c657ff Sep 28 17:14:58 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:58 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-582f93fe-d4af-43ea-b820-cdf29ce6c2df 1073741824" returned: 0 in 0.785s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-582f93fe-d4af-43ea-b820-cdf29ce6c2df {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:58 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-582f93fe-d4af-43ea-b820-cdf29ce6c2df Sep 28 17:14:58 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:58 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57012ac5-af0e-4c12-a41b-06485acad485 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2659d942-849e-47c9-b07d-a4eec8c657ff" returned: 0 in 0.501s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57012ac5-af0e-4c12-a41b-06485acad485 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2659d942-849e-47c9-b07d-a4eec8c657ff {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:58 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2659d942-849e-47c9-b07d-a4eec8c657ff Sep 28 17:14:58 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:58 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-582f93fe-d4af-43ea-b820-cdf29ce6c2df" returned: 0 in 0.338s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f98c1866-a236-4d9d-9602-b16182b6c2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-582f93fe-d4af-43ea-b820-cdf29ce6c2df', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d59ef0b9-c66a-40a9-9f42-9c0a9390bec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:58 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Volume volume-582f93fe-d4af-43ea-b820-cdf29ce6c2df (582f93fe-d4af-43ea-b820-cdf29ce6c2df): created successfully Sep 28 17:14:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d59ef0b9-c66a-40a9-9f42-9c0a9390bec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Flow 'volume_create_manager' (11f61722-2b9a-4269-b453-f0742f700b3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:58 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-cc624d05-3209-4587-945a-91ae56572017 tempest-VolumesListTestJSON-2002631624 None] Created volume successfully. Sep 28 17:14:58 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57012ac5-af0e-4c12-a41b-06485acad485 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2659d942-849e-47c9-b07d-a4eec8c657ff" returned: 0 in 0.406s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:58 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-57012ac5-af0e-4c12-a41b-06485acad485 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-2659d942-849e-47c9-b07d-a4eec8c657ff" released by "delete_volume" :: held 0.973s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:58 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-57012ac5-af0e-4c12-a41b-06485acad485 tempest-VolumesSnapshotTestJSON-999222795 None] Created reservations ['03929470-c617-4c54-9763-3e33e5c39db4', 'ce07218c-5133-495f-8f12-e48019b77561', '46b8baa7-6ae1-4543-87ed-c2c7afdd9a5e', 'c1f99882-c88f-49d2-9a82-5db3befe091c'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-57012ac5-af0e-4c12-a41b-06485acad485 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-57012ac5-af0e-4c12-a41b-06485acad485 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-57012ac5-af0e-4c12-a41b-06485acad485 tempest-VolumesSnapshotTestJSON-999222795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-57012ac5-af0e-4c12-a41b-06485acad485 tempest-VolumesSnapshotTestJSON-999222795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-57012ac5-af0e-4c12-a41b-06485acad485 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57012ac5-af0e-4c12-a41b-06485acad485 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:59 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:14:59 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:59 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57012ac5-af0e-4c12-a41b-06485acad485 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.298s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:59 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-57012ac5-af0e-4c12-a41b-06485acad485 tempest-VolumesSnapshotTestJSON-999222795 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:59 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-57012ac5-af0e-4c12-a41b-06485acad485 tempest-VolumesSnapshotTestJSON-999222795 None] Deleted volume successfully. Sep 28 17:14:59 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-57012ac5-af0e-4c12-a41b-06485acad485 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-2659d942-849e-47c9-b07d-a4eec8c657ff-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:59 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Flow 'volume_create_manager' (e9e87af7-610c-4793-9ec8-f2d55c2591ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d4940f-4815-4000-94e8-b0c196b696b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d4940f-4815-4000-94e8-b0c196b696b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-809650311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376769f7-0cee-4df4-9300-06ab938d08c4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b3acaafd9e84defa885c255b35e3b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:00Z,use_quota=True,user_id='4b1367522faa492f8b0e36133d42b5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88fdd014-e01f-42c6-8edf-bc0595dc01be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88fdd014-e01f-42c6-8edf-bc0595dc01be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dffa56b-88a3-4fa8-abb6-7e4d47e41e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dffa56b-88a3-4fa8-abb6-7e4d47e41e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376769f7-0cee-4df4-9300-06ab938d08c4', 'volume_name': 'volume-376769f7-0cee-4df4-9300-06ab938d08c4', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69fc500c-1da6-44d2-ae59-f34d49184f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69fc500c-1da6-44d2-ae59-f34d49184f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb951cf8-b52a-41b2-bc8d-4dcaf656d93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:00 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Volume 376769f7-0cee-4df4-9300-06ab938d08c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376769f7-0cee-4df4-9300-06ab938d08c4', 'volume_size': 1} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-809650311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376769f7-0cee-4df4-9300-06ab938d08c4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b3acaafd9e84defa885c255b35e3b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:00Z,use_quota=True,user_id='4b1367522faa492f8b0e36133d42b5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Creating volume 376769f7-0cee-4df4-9300-06ab938d08c4 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:00 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-376769f7-0cee-4df4-9300-06ab938d08c4 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:00 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-376769f7-0cee-4df4-9300-06ab938d08c4 1073741824 Sep 28 17:15:00 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-b3deb5c6-08e5-4727-bda5-d5d46aa3c4c3 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-419d2703-a714-4710-9899-e97834deb6c0-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-b3deb5c6-08e5-4727-bda5-d5d46aa3c4c3 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-419d2703-a714-4710-9899-e97834deb6c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-b3deb5c6-08e5-4727-bda5-d5d46aa3c4c3 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-quobyte-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-b3deb5c6-08e5-4727-bda5-d5d46aa3c4c3 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-b3deb5c6-08e5-4727-bda5-d5d46aa3c4c3 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-quobyte-419d2703-a714-4710-9899-e97834deb6c0" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-b3deb5c6-08e5-4727-bda5-d5d46aa3c4c3 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-419d2703-a714-4710-9899-e97834deb6c0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-b3deb5c6-08e5-4727-bda5-d5d46aa3c4c3 tempest-VolumesSnapshotTestJSON-999222795 None] Deleting offline snapshot 419d2703-a714-4710-9899-e97834deb6c0 of volume a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-b3deb5c6-08e5-4727-bda5-d5d46aa3c4c3 tempest-VolumesSnapshotTestJSON-999222795 None] snapshot_file for this snap is: volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af5a7eb-2bcf-4c48-8633-c1fe5725f9fe]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b3deb5c6-08e5-4727-bda5-d5d46aa3c4c3 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:00 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0 Sep 28 17:15:00 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:00 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-376769f7-0cee-4df4-9300-06ab938d08c4 1073741824" returned: 0 in 0.597s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-376769f7-0cee-4df4-9300-06ab938d08c4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:00 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-376769f7-0cee-4df4-9300-06ab938d08c4 Sep 28 17:15:00 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:00 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b3deb5c6-08e5-4727-bda5-d5d46aa3c4c3 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0" returned: 0 in 0.507s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-b3deb5c6-08e5-4727-bda5-d5d46aa3c4c3 tempest-VolumesSnapshotTestJSON-999222795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c65d1c1-cfc0-4c29-b14d-a47748cd19f4]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b3deb5c6-08e5-4727-bda5-d5d46aa3c4c3 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:00 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 Sep 28 17:15:00 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:01 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-376769f7-0cee-4df4-9300-06ab938d08c4" returned: 0 in 0.291s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb951cf8-b52a-41b2-bc8d-4dcaf656d93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376769f7-0cee-4df4-9300-06ab938d08c4', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb20fe1-ed18-47cc-bef1-278d6552ce91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:01 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Volume volume-376769f7-0cee-4df4-9300-06ab938d08c4 (376769f7-0cee-4df4-9300-06ab938d08c4): created successfully Sep 28 17:15:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb20fe1-ed18-47cc-bef1-278d6552ce91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Flow 'volume_create_manager' (e9e87af7-610c-4793-9ec8-f2d55c2591ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:01 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-81482581-4925-4633-9c1e-41d0ea15dbe4 tempest-VolumesListTestJSON-2002631624 None] Created volume successfully. Sep 28 17:15:01 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b3deb5c6-08e5-4727-bda5-d5d46aa3c4c3 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578" returned: 0 in 0.600s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b3deb5c6-08e5-4727-bda5-d5d46aa3c4c3 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:01 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0 Sep 28 17:15:01 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:01 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b3deb5c6-08e5-4727-bda5-d5d46aa3c4c3 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0" returned: 0 in 0.361s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b3deb5c6-08e5-4727-bda5-d5d46aa3c4c3 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:01 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0 Sep 28 17:15:01 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:02 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b3deb5c6-08e5-4727-bda5-d5d46aa3c4c3 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578.419d2703-a714-4710-9899-e97834deb6c0" returned: 0 in 0.303s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-b3deb5c6-08e5-4727-bda5-d5d46aa3c4c3 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-419d2703-a714-4710-9899-e97834deb6c0" released by "_delete_snapshot" :: held 1.963s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-b3deb5c6-08e5-4727-bda5-d5d46aa3c4c3 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578" released by "delete_snapshot" :: held 1.993s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-b3deb5c6-08e5-4727-bda5-d5d46aa3c4c3 tempest-VolumesSnapshotTestJSON-999222795 None] Created reservations ['f6343d30-166c-4803-bc84-382284f0dc77', '1772fbb8-c4f9-48f6-ab4a-7d0a48daf884', '7f2343e7-7aca-42bf-af09-1a80860e9925', '14c4096e-9c44-4bee-af01-bc91c520a5c0'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:02 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-b3deb5c6-08e5-4727-bda5-d5d46aa3c4c3 tempest-VolumesSnapshotTestJSON-999222795 None] Delete snapshot completed successfully. Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-b3deb5c6-08e5-4727-bda5-d5d46aa3c4c3 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-419d2703-a714-4710-9899-e97834deb6c0-delete_snapshot" released by "delete_snapshot" :: held 2.223s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Flow 'volume_create_manager' (8f0c6510-e122-46ec-bb0f-84b471d1bd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aea920b-b3e6-41eb-b645-c0d2889cfec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aea920b-b3e6-41eb-b645-c0d2889cfec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-453703941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ffad63-b69a-4410-be42-ee7e4c96f138,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b3acaafd9e84defa885c255b35e3b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:03Z,use_quota=True,user_id='4b1367522faa492f8b0e36133d42b5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97fbccf0-973a-4665-a892-2ee6b170d251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97fbccf0-973a-4665-a892-2ee6b170d251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3483e12a-fd90-49f1-a5bf-838bd3011901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3483e12a-fd90-49f1-a5bf-838bd3011901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56ffad63-b69a-4410-be42-ee7e4c96f138', 'volume_name': 'volume-56ffad63-b69a-4410-be42-ee7e4c96f138', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a47789-cdd4-475a-9911-835d0ac2601e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a47789-cdd4-475a-9911-835d0ac2601e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f13af3-99f5-4e31-a425-208541d43f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:02 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Volume 56ffad63-b69a-4410-be42-ee7e4c96f138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56ffad63-b69a-4410-be42-ee7e4c96f138', 'volume_size': 1} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-453703941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ffad63-b69a-4410-be42-ee7e4c96f138,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b3acaafd9e84defa885c255b35e3b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:03Z,use_quota=True,user_id='4b1367522faa492f8b0e36133d42b5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Creating volume 56ffad63-b69a-4410-be42-ee7e4c96f138 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:02 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:15:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-56ffad63-b69a-4410-be42-ee7e4c96f138 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:02 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-56ffad63-b69a-4410-be42-ee7e4c96f138 1073741824 Sep 28 17:15:02 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:03 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-56ffad63-b69a-4410-be42-ee7e4c96f138 1073741824" returned: 0 in 0.670s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-edd321be-32ed-49c1-9326-f66a98b61a89 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-edd321be-32ed-49c1-9326-f66a98b61a89 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-56ffad63-b69a-4410-be42-ee7e4c96f138 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:03 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-56ffad63-b69a-4410-be42-ee7e4c96f138 Sep 28 17:15:03 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-edd321be-32ed-49c1-9326-f66a98b61a89 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-quobyte-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-edd321be-32ed-49c1-9326-f66a98b61a89 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578" acquired by "delete_volume" :: waited 0.025s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:03 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5b3686-79c7-4e85-8497-3b8ab82ac208]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-edd321be-32ed-49c1-9326-f66a98b61a89 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:04 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 Sep 28 17:15:04 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:04 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-56ffad63-b69a-4410-be42-ee7e4c96f138" returned: 0 in 0.433s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f13af3-99f5-4e31-a425-208541d43f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56ffad63-b69a-4410-be42-ee7e4c96f138', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e645e8-22cd-47a1-9662-a2108a955179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:04 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Volume volume-56ffad63-b69a-4410-be42-ee7e4c96f138 (56ffad63-b69a-4410-be42-ee7e4c96f138): created successfully Sep 28 17:15:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e645e8-22cd-47a1-9662-a2108a955179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Flow 'volume_create_manager' (8f0c6510-e122-46ec-bb0f-84b471d1bd08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:04 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d24b9fad-e325-4e05-b28f-33c813e8d58c tempest-VolumesListTestJSON-2002631624 None] Created volume successfully. Sep 28 17:15:04 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-edd321be-32ed-49c1-9326-f66a98b61a89 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578" returned: 0 in 0.490s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-edd321be-32ed-49c1-9326-f66a98b61a89 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:04 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578 Sep 28 17:15:04 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:04 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-edd321be-32ed-49c1-9326-f66a98b61a89 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578" returned: 0 in 0.366s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-edd321be-32ed-49c1-9326-f66a98b61a89 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578" released by "delete_volume" :: held 0.964s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:04 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-edd321be-32ed-49c1-9326-f66a98b61a89 tempest-VolumesSnapshotTestJSON-999222795 None] Created reservations ['6df9f9b1-0f04-4a75-9d4e-e1b27fde63ff', '0f67b048-4864-4af2-b964-79412d5f3588', '29025f8b-c1ea-49c8-b8c3-a93ea55ad42a', 'e231856f-0cbd-404f-81bf-3e6dd34ec36b'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-edd321be-32ed-49c1-9326-f66a98b61a89 tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-edd321be-32ed-49c1-9326-f66a98b61a89 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-edd321be-32ed-49c1-9326-f66a98b61a89 tempest-VolumesSnapshotTestJSON-999222795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-edd321be-32ed-49c1-9326-f66a98b61a89 tempest-VolumesSnapshotTestJSON-999222795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-edd321be-32ed-49c1-9326-f66a98b61a89 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-edd321be-32ed-49c1-9326-f66a98b61a89 tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:05 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:15:05 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:05 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-edd321be-32ed-49c1-9326-f66a98b61a89 tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.380s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:05 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-edd321be-32ed-49c1-9326-f66a98b61a89 tempest-VolumesSnapshotTestJSON-999222795 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:05 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-edd321be-32ed-49c1-9326-f66a98b61a89 tempest-VolumesSnapshotTestJSON-999222795 None] Deleted volume successfully. Sep 28 17:15:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-edd321be-32ed-49c1-9326-f66a98b61a89 tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-a6d42566-a0fd-4ae2-9dac-e0f7c6ece578-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c6b584e3-5611-4028-aaf5-746a16b35add tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-ebe0034d-55a5-414c-83e6-353e4c101e32-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c6b584e3-5611-4028-aaf5-746a16b35add tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-ebe0034d-55a5-414c-83e6-353e4c101e32-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c6b584e3-5611-4028-aaf5-746a16b35add tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "cinder-quobyte-ebe0034d-55a5-414c-83e6-353e4c101e32" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c6b584e3-5611-4028-aaf5-746a16b35add tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-ebe0034d-55a5-414c-83e6-353e4c101e32" acquired by "delete_volume" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:06 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19dba00-a15e-4ca2-8c88-921d16be3f8c]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c6b584e3-5611-4028-aaf5-746a16b35add tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:06 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32 Sep 28 17:15:06 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:15:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:06 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c6b584e3-5611-4028-aaf5-746a16b35add tempest-VolumesSnapshotTestJSON-999222795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32" returned: 0 in 0.509s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c6b584e3-5611-4028-aaf5-746a16b35add tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:06 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:15:06 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:06 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32 Sep 28 17:15:06 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:07 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c6b584e3-5611-4028-aaf5-746a16b35add tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ebe0034d-55a5-414c-83e6-353e4c101e32" returned: 0 in 0.323s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:07 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.352s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c6b584e3-5611-4028-aaf5-746a16b35add tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-quobyte-ebe0034d-55a5-414c-83e6-353e4c101e32" released by "delete_volume" :: held 0.944s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:15:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:15:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:15:07 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-c6b584e3-5611-4028-aaf5-746a16b35add tempest-VolumesSnapshotTestJSON-999222795 None] Created reservations ['1cb2076d-e7a4-4731-9c1e-4db810ff9b41', '045e8032-fb1e-4d07-8583-9bb474e835bb', '982d8a6b-bdc8-486c-9651-90a66bc506ea', '2b041f5e-d875-4eae-b059-b1da676fcd63'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c6b584e3-5611-4028-aaf5-746a16b35add tempest-VolumesSnapshotTestJSON-999222795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c6b584e3-5611-4028-aaf5-746a16b35add tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c6b584e3-5611-4028-aaf5-746a16b35add tempest-VolumesSnapshotTestJSON-999222795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c6b584e3-5611-4028-aaf5-746a16b35add tempest-VolumesSnapshotTestJSON-999222795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c6b584e3-5611-4028-aaf5-746a16b35add tempest-VolumesSnapshotTestJSON-999222795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c6b584e3-5611-4028-aaf5-746a16b35add tempest-VolumesSnapshotTestJSON-999222795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:07 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:15:07 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:07 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c6b584e3-5611-4028-aaf5-746a16b35add tempest-VolumesSnapshotTestJSON-999222795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.298s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-c6b584e3-5611-4028-aaf5-746a16b35add tempest-VolumesSnapshotTestJSON-999222795 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:07 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-c6b584e3-5611-4028-aaf5-746a16b35add tempest-VolumesSnapshotTestJSON-999222795 None] Deleted volume successfully. Sep 28 17:15:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c6b584e3-5611-4028-aaf5-746a16b35add tempest-VolumesSnapshotTestJSON-999222795 None] Lock "cinder-ebe0034d-55a5-414c-83e6-353e4c101e32-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:08 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c915bdf4-77f2-4917-9d93-91744006bbdd tempest-VolumesListTestJSON-2002631624 None] Acquiring lock "cinder-56ffad63-b69a-4410-be42-ee7e4c96f138-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:08 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c915bdf4-77f2-4917-9d93-91744006bbdd tempest-VolumesListTestJSON-2002631624 None] Lock "cinder-56ffad63-b69a-4410-be42-ee7e4c96f138-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:08 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c915bdf4-77f2-4917-9d93-91744006bbdd tempest-VolumesListTestJSON-2002631624 None] Acquiring lock "cinder-quobyte-56ffad63-b69a-4410-be42-ee7e4c96f138" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:08 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c915bdf4-77f2-4917-9d93-91744006bbdd tempest-VolumesListTestJSON-2002631624 None] Lock "cinder-quobyte-56ffad63-b69a-4410-be42-ee7e4c96f138" acquired by "delete_volume" :: waited 0.032s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:08 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec5e351-aa85-425f-9ab9-7e338019028f]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c915bdf4-77f2-4917-9d93-91744006bbdd tempest-VolumesListTestJSON-2002631624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-56ffad63-b69a-4410-be42-ee7e4c96f138 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:08 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-56ffad63-b69a-4410-be42-ee7e4c96f138 Sep 28 17:15:08 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:08 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c915bdf4-77f2-4917-9d93-91744006bbdd tempest-VolumesListTestJSON-2002631624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-56ffad63-b69a-4410-be42-ee7e4c96f138" returned: 0 in 0.529s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c915bdf4-77f2-4917-9d93-91744006bbdd tempest-VolumesListTestJSON-2002631624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-56ffad63-b69a-4410-be42-ee7e4c96f138 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:08 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-56ffad63-b69a-4410-be42-ee7e4c96f138 Sep 28 17:15:08 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:09 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c915bdf4-77f2-4917-9d93-91744006bbdd tempest-VolumesListTestJSON-2002631624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-56ffad63-b69a-4410-be42-ee7e4c96f138" returned: 0 in 0.339s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c915bdf4-77f2-4917-9d93-91744006bbdd tempest-VolumesListTestJSON-2002631624 None] Lock "cinder-quobyte-56ffad63-b69a-4410-be42-ee7e4c96f138" released by "delete_volume" :: held 0.929s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:09 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-c915bdf4-77f2-4917-9d93-91744006bbdd tempest-VolumesListTestJSON-2002631624 None] Created reservations ['d6edfae3-79cf-47e4-b1d0-1c453862bb00', '9fc623b5-e925-4d93-a24a-c8310d99707b', 'e6d64f81-0513-40dd-a310-d519499dce27', '461cb32e-a30b-45f8-ae61-69a66ec4dc5a'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c915bdf4-77f2-4917-9d93-91744006bbdd tempest-VolumesListTestJSON-2002631624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c915bdf4-77f2-4917-9d93-91744006bbdd tempest-VolumesListTestJSON-2002631624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c915bdf4-77f2-4917-9d93-91744006bbdd tempest-VolumesListTestJSON-2002631624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c915bdf4-77f2-4917-9d93-91744006bbdd tempest-VolumesListTestJSON-2002631624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c915bdf4-77f2-4917-9d93-91744006bbdd tempest-VolumesListTestJSON-2002631624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c915bdf4-77f2-4917-9d93-91744006bbdd tempest-VolumesListTestJSON-2002631624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:09 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:15:09 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3ed9cbb5-7d88-4d86-92dc-3eb5c4d47689 tempest-VolumesListTestJSON-2002631624 None] Acquiring lock "cinder-376769f7-0cee-4df4-9300-06ab938d08c4-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3ed9cbb5-7d88-4d86-92dc-3eb5c4d47689 tempest-VolumesListTestJSON-2002631624 None] Lock "cinder-376769f7-0cee-4df4-9300-06ab938d08c4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3ed9cbb5-7d88-4d86-92dc-3eb5c4d47689 tempest-VolumesListTestJSON-2002631624 None] Acquiring lock "cinder-quobyte-376769f7-0cee-4df4-9300-06ab938d08c4" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3ed9cbb5-7d88-4d86-92dc-3eb5c4d47689 tempest-VolumesListTestJSON-2002631624 None] Lock "cinder-quobyte-376769f7-0cee-4df4-9300-06ab938d08c4" acquired by "delete_volume" :: waited 0.025s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:09 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c89548b-eba7-4ad9-ad2e-def961b2b34e]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3ed9cbb5-7d88-4d86-92dc-3eb5c4d47689 tempest-VolumesListTestJSON-2002631624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-376769f7-0cee-4df4-9300-06ab938d08c4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:09 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c915bdf4-77f2-4917-9d93-91744006bbdd tempest-VolumesListTestJSON-2002631624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.435s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:09 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-c915bdf4-77f2-4917-9d93-91744006bbdd tempest-VolumesListTestJSON-2002631624 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:09 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-c915bdf4-77f2-4917-9d93-91744006bbdd tempest-VolumesListTestJSON-2002631624 None] Deleted volume successfully. Sep 28 17:15:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c915bdf4-77f2-4917-9d93-91744006bbdd tempest-VolumesListTestJSON-2002631624 None] Lock "cinder-56ffad63-b69a-4410-be42-ee7e4c96f138-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:09 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-376769f7-0cee-4df4-9300-06ab938d08c4 Sep 28 17:15:09 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:10 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3ed9cbb5-7d88-4d86-92dc-3eb5c4d47689 tempest-VolumesListTestJSON-2002631624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-376769f7-0cee-4df4-9300-06ab938d08c4" returned: 0 in 0.518s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3ed9cbb5-7d88-4d86-92dc-3eb5c4d47689 tempest-VolumesListTestJSON-2002631624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-376769f7-0cee-4df4-9300-06ab938d08c4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:10 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-376769f7-0cee-4df4-9300-06ab938d08c4 Sep 28 17:15:10 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:10 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3ed9cbb5-7d88-4d86-92dc-3eb5c4d47689 tempest-VolumesListTestJSON-2002631624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-376769f7-0cee-4df4-9300-06ab938d08c4" returned: 0 in 0.315s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3ed9cbb5-7d88-4d86-92dc-3eb5c4d47689 tempest-VolumesListTestJSON-2002631624 None] Lock "cinder-quobyte-376769f7-0cee-4df4-9300-06ab938d08c4" released by "delete_volume" :: held 0.928s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:10 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-3ed9cbb5-7d88-4d86-92dc-3eb5c4d47689 tempest-VolumesListTestJSON-2002631624 None] Created reservations ['30e048d3-a1a0-44cc-a5c4-c7dd8f76ce14', 'a5870749-233e-48fd-82f9-cae712103417', 'cc2e145c-2bd6-4e0e-9d21-3df8f4effc8f', '71751f33-c07a-41f9-bb1d-72b167a60309'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3ed9cbb5-7d88-4d86-92dc-3eb5c4d47689 tempest-VolumesListTestJSON-2002631624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3ed9cbb5-7d88-4d86-92dc-3eb5c4d47689 tempest-VolumesListTestJSON-2002631624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3ed9cbb5-7d88-4d86-92dc-3eb5c4d47689 tempest-VolumesListTestJSON-2002631624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3ed9cbb5-7d88-4d86-92dc-3eb5c4d47689 tempest-VolumesListTestJSON-2002631624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3ed9cbb5-7d88-4d86-92dc-3eb5c4d47689 tempest-VolumesListTestJSON-2002631624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3ed9cbb5-7d88-4d86-92dc-3eb5c4d47689 tempest-VolumesListTestJSON-2002631624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:10 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:15:10 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:11 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3ed9cbb5-7d88-4d86-92dc-3eb5c4d47689 tempest-VolumesListTestJSON-2002631624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.370s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:11 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-3ed9cbb5-7d88-4d86-92dc-3eb5c4d47689 tempest-VolumesListTestJSON-2002631624 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:11 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-3ed9cbb5-7d88-4d86-92dc-3eb5c4d47689 tempest-VolumesListTestJSON-2002631624 None] Deleted volume successfully. Sep 28 17:15:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3ed9cbb5-7d88-4d86-92dc-3eb5c4d47689 tempest-VolumesListTestJSON-2002631624 None] Lock "cinder-376769f7-0cee-4df4-9300-06ab938d08c4-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a94837f4-d377-4a53-beb0-541d28292d10 tempest-VolumesListTestJSON-2002631624 None] Acquiring lock "cinder-582f93fe-d4af-43ea-b820-cdf29ce6c2df-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a94837f4-d377-4a53-beb0-541d28292d10 tempest-VolumesListTestJSON-2002631624 None] Lock "cinder-582f93fe-d4af-43ea-b820-cdf29ce6c2df-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a94837f4-d377-4a53-beb0-541d28292d10 tempest-VolumesListTestJSON-2002631624 None] Acquiring lock "cinder-quobyte-582f93fe-d4af-43ea-b820-cdf29ce6c2df" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a94837f4-d377-4a53-beb0-541d28292d10 tempest-VolumesListTestJSON-2002631624 None] Lock "cinder-quobyte-582f93fe-d4af-43ea-b820-cdf29ce6c2df" acquired by "delete_volume" :: waited 0.024s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:11 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[61882510-e401-46e5-a3d5-01b1c1e2e62d]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a94837f4-d377-4a53-beb0-541d28292d10 tempest-VolumesListTestJSON-2002631624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-582f93fe-d4af-43ea-b820-cdf29ce6c2df {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:12 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-582f93fe-d4af-43ea-b820-cdf29ce6c2df Sep 28 17:15:12 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:12 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a94837f4-d377-4a53-beb0-541d28292d10 tempest-VolumesListTestJSON-2002631624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-582f93fe-d4af-43ea-b820-cdf29ce6c2df" returned: 0 in 0.566s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a94837f4-d377-4a53-beb0-541d28292d10 tempest-VolumesListTestJSON-2002631624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-582f93fe-d4af-43ea-b820-cdf29ce6c2df {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:12 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-582f93fe-d4af-43ea-b820-cdf29ce6c2df Sep 28 17:15:12 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:13 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a94837f4-d377-4a53-beb0-541d28292d10 tempest-VolumesListTestJSON-2002631624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-582f93fe-d4af-43ea-b820-cdf29ce6c2df" returned: 0 in 0.459s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a94837f4-d377-4a53-beb0-541d28292d10 tempest-VolumesListTestJSON-2002631624 None] Lock "cinder-quobyte-582f93fe-d4af-43ea-b820-cdf29ce6c2df" released by "delete_volume" :: held 1.113s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:13 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-a94837f4-d377-4a53-beb0-541d28292d10 tempest-VolumesListTestJSON-2002631624 None] Created reservations ['8ff9dc12-fb42-4987-9069-db60e8ae1229', '1194ac2d-b910-4aab-a884-2a79bb4c39ea', '88f1cc6f-5dea-4b6c-a3cb-ef5665c3d2be', 'd815526f-b963-4af4-bad3-86a08192fa7a'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a94837f4-d377-4a53-beb0-541d28292d10 tempest-VolumesListTestJSON-2002631624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a94837f4-d377-4a53-beb0-541d28292d10 tempest-VolumesListTestJSON-2002631624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:13 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a94837f4-d377-4a53-beb0-541d28292d10 tempest-VolumesListTestJSON-2002631624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:13 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a94837f4-d377-4a53-beb0-541d28292d10 tempest-VolumesListTestJSON-2002631624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a94837f4-d377-4a53-beb0-541d28292d10 tempest-VolumesListTestJSON-2002631624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a94837f4-d377-4a53-beb0-541d28292d10 tempest-VolumesListTestJSON-2002631624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:13 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:15:13 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:13 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a94837f4-d377-4a53-beb0-541d28292d10 tempest-VolumesListTestJSON-2002631624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.353s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:13 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-a94837f4-d377-4a53-beb0-541d28292d10 tempest-VolumesListTestJSON-2002631624 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:13 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a94837f4-d377-4a53-beb0-541d28292d10 tempest-VolumesListTestJSON-2002631624 None] Deleted volume successfully. Sep 28 17:15:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a94837f4-d377-4a53-beb0-541d28292d10 tempest-VolumesListTestJSON-2002631624 None] Lock "cinder-582f93fe-d4af-43ea-b820-cdf29ce6c2df-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:20 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:20 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Flow 'volume_create_manager' (97c5859e-8aa1-4e77-abab-143400f5612d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:20 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b0e9de-d535-4d14-80a7-f61ed2adb88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:20 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b0e9de-d535-4d14-80a7-f61ed2adb88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1783308862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02333b62-974e-4da6-a810-8d4d61fd7222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d66a8ed020e649118697ee930085c4c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:20Z,use_quota=True,user_id='d07c96a5a91f4c4ba1f05f65db4654df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:20 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822637dd-ee47-4345-bc8a-df65c8b48f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:20 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822637dd-ee47-4345-bc8a-df65c8b48f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:20 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04cfa9e9-3341-4c30-aa46-fea52abb990b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:20 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04cfa9e9-3341-4c30-aa46-fea52abb990b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02333b62-974e-4da6-a810-8d4d61fd7222', 'volume_name': 'volume-02333b62-974e-4da6-a810-8d4d61fd7222', 'volume_size': 2}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:20 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (312479c3-f000-4f66-83d1-e0a03b7ad6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:20 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (312479c3-f000-4f66-83d1-e0a03b7ad6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:20 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc43b99d-2294-4139-92e2-67c6ae5bd0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:20 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Volume 02333b62-974e-4da6-a810-8d4d61fd7222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02333b62-974e-4da6-a810-8d4d61fd7222', 'volume_size': 2} Sep 28 17:15:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:20 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1783308862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02333b62-974e-4da6-a810-8d4d61fd7222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d66a8ed020e649118697ee930085c4c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:20Z,use_quota=True,user_id='d07c96a5a91f4c4ba1f05f65db4654df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:20 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Creating volume 02333b62-974e-4da6-a810-8d4d61fd7222 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:20 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:20 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:20 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:20 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:15:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222 2147483648 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:20 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222 2147483648 Sep 28 17:15:20 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:21 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222 2147483648" returned: 0 in 0.809s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:21 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222 Sep 28 17:15:21 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:21 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222" returned: 0 in 0.442s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:22 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc43b99d-2294-4139-92e2-67c6ae5bd0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02333b62-974e-4da6-a810-8d4d61fd7222', 'volume_size': 2}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3eccf76-a2d5-4bbe-8d0c-7d7bb5fe0e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:22 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Volume volume-02333b62-974e-4da6-a810-8d4d61fd7222 (02333b62-974e-4da6-a810-8d4d61fd7222): created successfully Sep 28 17:15:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3eccf76-a2d5-4bbe-8d0c-7d7bb5fe0e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Flow 'volume_create_manager' (97c5859e-8aa1-4e77-abab-143400f5612d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:22 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-ad215836-9ad2-4b7e-9ee8-c26c5b29ff44 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Created volume successfully. Sep 28 17:15:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-22c92940-58ff-4a1e-98b1-aebe0036490a tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-22c92940-58ff-4a1e-98b1-aebe0036490a tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:23 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-22c92940-58ff-4a1e-98b1-aebe0036490a tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Creating offline snapshot e3c68af5-12a9-4e03-91e0-a92986cca576 of volume 02333b62-974e-4da6-a810-8d4d61fd7222 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:15:23 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c88a142-d37d-4527-b770-242a5e702628]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-22c92940-58ff-4a1e-98b1-aebe0036490a tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:23 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222 Sep 28 17:15:23 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:23 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-22c92940-58ff-4a1e-98b1-aebe0036490a tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222" returned: 0 in 0.580s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-22c92940-58ff-4a1e-98b1-aebe0036490a tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.e3c68af5-12a9-4e03-91e0-a92986cca576 2G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:23 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.e3c68af5-12a9-4e03-91e0-a92986cca576 2G Sep 28 17:15:23 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:24 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-22c92940-58ff-4a1e-98b1-aebe0036490a tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.e3c68af5-12a9-4e03-91e0-a92986cca576 2G" returned: 0 in 0.576s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-22c92940-58ff-4a1e-98b1-aebe0036490a tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02333b62-974e-4da6-a810-8d4d61fd7222 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.e3c68af5-12a9-4e03-91e0-a92986cca576 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:24 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02333b62-974e-4da6-a810-8d4d61fd7222 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.e3c68af5-12a9-4e03-91e0-a92986cca576 Sep 28 17:15:24 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:24 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-22c92940-58ff-4a1e-98b1-aebe0036490a tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02333b62-974e-4da6-a810-8d4d61fd7222 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.e3c68af5-12a9-4e03-91e0-a92986cca576" returned: 0 in 0.473s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:24 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-22c92940-58ff-4a1e-98b1-aebe0036490a tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.e3c68af5-12a9-4e03-91e0-a92986cca576 is being set with open permissions: ugo+rw Sep 28 17:15:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-22c92940-58ff-4a1e-98b1-aebe0036490a tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.e3c68af5-12a9-4e03-91e0-a92986cca576 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:24 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.e3c68af5-12a9-4e03-91e0-a92986cca576 Sep 28 17:15:24 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:25 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-22c92940-58ff-4a1e-98b1-aebe0036490a tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.e3c68af5-12a9-4e03-91e0-a92986cca576" returned: 0 in 0.319s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-22c92940-58ff-4a1e-98b1-aebe0036490a tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:25 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.info Sep 28 17:15:25 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:25 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-22c92940-58ff-4a1e-98b1-aebe0036490a tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.info" returned: 0 in 0.293s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:25 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-22c92940-58ff-4a1e-98b1-aebe0036490a tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.info is being set with open permissions: ugo+rw Sep 28 17:15:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-22c92940-58ff-4a1e-98b1-aebe0036490a tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:25 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.info Sep 28 17:15:25 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:25 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-22c92940-58ff-4a1e-98b1-aebe0036490a tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.info" returned: 0 in 0.346s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-22c92940-58ff-4a1e-98b1-aebe0036490a tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.751s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:25 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-22c92940-58ff-4a1e-98b1-aebe0036490a tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Create snapshot completed successfully Sep 28 17:15:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bdaf5441-b86c-4929-9d93-b093335a0966 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Acquiring lock "cinder-e3c68af5-12a9-4e03-91e0-a92986cca576-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bdaf5441-b86c-4929-9d93-b093335a0966 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Lock "cinder-e3c68af5-12a9-4e03-91e0-a92986cca576-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bdaf5441-b86c-4929-9d93-b093335a0966 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Acquiring lock "cinder-quobyte-02333b62-974e-4da6-a810-8d4d61fd7222" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bdaf5441-b86c-4929-9d93-b093335a0966 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Lock "cinder-quobyte-02333b62-974e-4da6-a810-8d4d61fd7222" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bdaf5441-b86c-4929-9d93-b093335a0966 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Acquiring lock "cinder-quobyte-e3c68af5-12a9-4e03-91e0-a92986cca576" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bdaf5441-b86c-4929-9d93-b093335a0966 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Lock "cinder-quobyte-e3c68af5-12a9-4e03-91e0-a92986cca576" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-bdaf5441-b86c-4929-9d93-b093335a0966 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Deleting offline snapshot e3c68af5-12a9-4e03-91e0-a92986cca576 of volume 02333b62-974e-4da6-a810-8d4d61fd7222 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:15:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-bdaf5441-b86c-4929-9d93-b093335a0966 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] snapshot_file for this snap is: volume-02333b62-974e-4da6-a810-8d4d61fd7222.e3c68af5-12a9-4e03-91e0-a92986cca576 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:15:26 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[77613266-79a3-4913-a5f2-f174229cb61f]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bdaf5441-b86c-4929-9d93-b093335a0966 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.e3c68af5-12a9-4e03-91e0-a92986cca576 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:26 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.e3c68af5-12a9-4e03-91e0-a92986cca576 Sep 28 17:15:26 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:26 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bdaf5441-b86c-4929-9d93-b093335a0966 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.e3c68af5-12a9-4e03-91e0-a92986cca576" returned: 0 in 0.503s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-bdaf5441-b86c-4929-9d93-b093335a0966 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02333b62-974e-4da6-a810-8d4d61fd7222(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:15:27 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a120e8-ca2c-4537-bfb7-af67a7d23ea7]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bdaf5441-b86c-4929-9d93-b093335a0966 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:27 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222 Sep 28 17:15:27 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:27 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bdaf5441-b86c-4929-9d93-b093335a0966 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222" returned: 0 in 0.526s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bdaf5441-b86c-4929-9d93-b093335a0966 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.e3c68af5-12a9-4e03-91e0-a92986cca576 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:27 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.e3c68af5-12a9-4e03-91e0-a92986cca576 Sep 28 17:15:27 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:28 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bdaf5441-b86c-4929-9d93-b093335a0966 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.e3c68af5-12a9-4e03-91e0-a92986cca576" returned: 0 in 0.722s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bdaf5441-b86c-4929-9d93-b093335a0966 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.e3c68af5-12a9-4e03-91e0-a92986cca576 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:28 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.e3c68af5-12a9-4e03-91e0-a92986cca576 Sep 28 17:15:28 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:28 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bdaf5441-b86c-4929-9d93-b093335a0966 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222.e3c68af5-12a9-4e03-91e0-a92986cca576" returned: 0 in 0.548s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:28 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bdaf5441-b86c-4929-9d93-b093335a0966 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Lock "cinder-quobyte-e3c68af5-12a9-4e03-91e0-a92986cca576" released by "_delete_snapshot" :: held 2.487s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:28 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bdaf5441-b86c-4929-9d93-b093335a0966 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Lock "cinder-quobyte-02333b62-974e-4da6-a810-8d4d61fd7222" released by "delete_snapshot" :: held 2.515s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:29 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-bdaf5441-b86c-4929-9d93-b093335a0966 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Created reservations ['06bf7ce7-4194-4bdb-ae95-48550ec4f6da', '874e4c4c-5a41-4709-956d-7860ec1ecb81', 'a07baa72-affa-4fca-84ec-0253939371c9', 'd95da6cc-7dc7-4558-9034-9c03b126e34a'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:29 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-bdaf5441-b86c-4929-9d93-b093335a0966 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Delete snapshot completed successfully. Sep 28 17:15:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bdaf5441-b86c-4929-9d93-b093335a0966 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Lock "cinder-e3c68af5-12a9-4e03-91e0-a92986cca576-delete_snapshot" released by "delete_snapshot" :: held 2.804s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3e3711f4-be9b-4b4b-bf7c-9f589d392965 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Acquiring lock "cinder-02333b62-974e-4da6-a810-8d4d61fd7222-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3e3711f4-be9b-4b4b-bf7c-9f589d392965 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Lock "cinder-02333b62-974e-4da6-a810-8d4d61fd7222-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3e3711f4-be9b-4b4b-bf7c-9f589d392965 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Acquiring lock "cinder-quobyte-02333b62-974e-4da6-a810-8d4d61fd7222" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3e3711f4-be9b-4b4b-bf7c-9f589d392965 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Lock "cinder-quobyte-02333b62-974e-4da6-a810-8d4d61fd7222" acquired by "delete_volume" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:29 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[985c74c7-b723-4226-9eab-1ac4112f2c19]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3e3711f4-be9b-4b4b-bf7c-9f589d392965 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:30 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222 Sep 28 17:15:30 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:30 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3e3711f4-be9b-4b4b-bf7c-9f589d392965 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222" returned: 0 in 0.636s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3e3711f4-be9b-4b4b-bf7c-9f589d392965 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:30 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222 Sep 28 17:15:30 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:31 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3e3711f4-be9b-4b4b-bf7c-9f589d392965 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-02333b62-974e-4da6-a810-8d4d61fd7222" returned: 0 in 0.471s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3e3711f4-be9b-4b4b-bf7c-9f589d392965 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Lock "cinder-quobyte-02333b62-974e-4da6-a810-8d4d61fd7222" released by "delete_volume" :: held 1.219s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:31 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-3e3711f4-be9b-4b4b-bf7c-9f589d392965 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Created reservations ['acd91634-138b-4515-ba43-fd212c873359', '7b17aa1c-cecb-44d9-9d16-d7584674efc1', 'ee696cd8-9a6c-4ec8-acd2-1d09e8b6142d', '8a46a57c-6a78-4562-a0e3-0015dc0a558a'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3e3711f4-be9b-4b4b-bf7c-9f589d392965 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3e3711f4-be9b-4b4b-bf7c-9f589d392965 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:31 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3e3711f4-be9b-4b4b-bf7c-9f589d392965 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:31 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3e3711f4-be9b-4b4b-bf7c-9f589d392965 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3e3711f4-be9b-4b4b-bf7c-9f589d392965 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3e3711f4-be9b-4b4b-bf7c-9f589d392965 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:31 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:15:31 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:31 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3e3711f4-be9b-4b4b-bf7c-9f589d392965 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.314s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:31 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-3e3711f4-be9b-4b4b-bf7c-9f589d392965 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:31 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-3e3711f4-be9b-4b4b-bf7c-9f589d392965 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Deleted volume successfully. Sep 28 17:15:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3e3711f4-be9b-4b4b-bf7c-9f589d392965 tempest-VolumesSnapshotNegativeTestJSON-2075126542 None] Lock "cinder-02333b62-974e-4da6-a810-8d4d61fd7222-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:41 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=118,cinder:INSERT=48,cinder:UPDATE=146,cinder:DELETE=10 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:15:41 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:INSERT=47,cinder:SELECT=115,cinder:UPDATE=159,cinder:DELETE=15 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:15:54 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:54 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Flow 'volume_create_manager' (17836f47-c845-4998-ae17-24467848d68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:54 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b704e3c8-b238-4228-8a66-4e06dbc5137e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:54 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b704e3c8-b238-4228-8a66-4e06dbc5137e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1304926984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e237d92a-013f-4c5e-ba60-ee243b45ba6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3934e9248fa84fb7ba6094a5346f36cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:55Z,use_quota=True,user_id='a74c5dfd1b034b25bef3aba6bd86e3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:54 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d50c9c-19b4-487d-aff1-41e783daa308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:54 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d50c9c-19b4-487d-aff1-41e783daa308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:54 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f17d11-07dc-4c3b-88e9-d1800e3b478f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:54 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f17d11-07dc-4c3b-88e9-d1800e3b478f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e237d92a-013f-4c5e-ba60-ee243b45ba6b', 'volume_name': 'volume-e237d92a-013f-4c5e-ba60-ee243b45ba6b', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:54 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b890896-03d3-464c-ada6-d51fb8e1f308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:54 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b890896-03d3-464c-ada6-d51fb8e1f308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:54 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c65dba09-9b9e-4a38-89c0-04790ed16aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:54 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Volume e237d92a-013f-4c5e-ba60-ee243b45ba6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e237d92a-013f-4c5e-ba60-ee243b45ba6b', 'volume_size': 1} Sep 28 17:15:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:54 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1304926984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e237d92a-013f-4c5e-ba60-ee243b45ba6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3934e9248fa84fb7ba6094a5346f36cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:55Z,use_quota=True,user_id='a74c5dfd1b034b25bef3aba6bd86e3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:54 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Creating volume e237d92a-013f-4c5e-ba60-ee243b45ba6b {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:54 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:54 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:54 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:54 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:15:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e237d92a-013f-4c5e-ba60-ee243b45ba6b 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:54 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e237d92a-013f-4c5e-ba60-ee243b45ba6b 1073741824 Sep 28 17:15:54 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:55 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e237d92a-013f-4c5e-ba60-ee243b45ba6b 1073741824" returned: 0 in 0.599s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e237d92a-013f-4c5e-ba60-ee243b45ba6b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:55 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e237d92a-013f-4c5e-ba60-ee243b45ba6b Sep 28 17:15:55 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:55 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e237d92a-013f-4c5e-ba60-ee243b45ba6b" returned: 0 in 0.390s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:55 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c65dba09-9b9e-4a38-89c0-04790ed16aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e237d92a-013f-4c5e-ba60-ee243b45ba6b', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9124948-90c3-43a8-8247-ac669caf9b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:55 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Volume volume-e237d92a-013f-4c5e-ba60-ee243b45ba6b (e237d92a-013f-4c5e-ba60-ee243b45ba6b): created successfully Sep 28 17:15:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9124948-90c3-43a8-8247-ac669caf9b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Flow 'volume_create_manager' (17836f47-c845-4998-ae17-24467848d68f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:55 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-73b2c7ac-7242-4833-b4c2-6618dc8997fc tempest-AttachVolumeNegativeTest-648762481 None] Created volume successfully. Sep 28 17:15:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-f1bdb873-5cd2-4527-a471-82ac59af97bf req-7d753471-531a-42b2-87d1-431a5431eaec tempest-AttachVolumeNegativeTest-648762481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-f1bdb873-5cd2-4527-a471-82ac59af97bf req-7d753471-531a-42b2-87d1-431a5431eaec tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-f1bdb873-5cd2-4527-a471-82ac59af97bf req-7d753471-531a-42b2-87d1-431a5431eaec tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-f1bdb873-5cd2-4527-a471-82ac59af97bf req-7d753471-531a-42b2-87d1-431a5431eaec tempest-AttachVolumeNegativeTest-648762481 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-e237d92a-013f-4c5e-ba60-ee243b45ba6b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a79a5fb-3af8-49cc-803d-8d0f875f4e0e', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:15:57 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-f1bdb873-5cd2-4527-a471-82ac59af97bf req-7d753471-531a-42b2-87d1-431a5431eaec tempest-AttachVolumeNegativeTest-648762481 None] attachment_update completed successfully. Sep 28 17:16:01 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Flow 'volume_create_manager' (a452bf0c-0c01-4293-aca7-3958dc1f6a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341eb4d5-8e23-49f1-be34-468c3db31422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341eb4d5-8e23-49f1-be34-468c3db31422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1030481163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f61634f-8a10-414b-9b42-39935395f67b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918ed0c9482c4c9eb6dbeba2aaa65258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:01Z,use_quota=True,user_id='83cd1226fafa407c974f8d13c152004b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53f9f925-ea53-4c27-b67e-da9decab045f),volume_type_id=53f9f925-ea53-4c27-b67e-da9decab045f)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df878926-1efe-45bb-8e66-a1edfce86a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df878926-1efe-45bb-8e66-a1edfce86a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f382a036-4f8c-4ade-abbb-4b520d4155b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f382a036-4f8c-4ade-abbb-4b520d4155b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f61634f-8a10-414b-9b42-39935395f67b', 'volume_name': 'volume-3f61634f-8a10-414b-9b42-39935395f67b', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a75c6386-532d-4a31-b8c9-61d226a93ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a75c6386-532d-4a31-b8c9-61d226a93ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9fc689b-23b8-4eb1-b9b0-ca615b9d6445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:01 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Volume 3f61634f-8a10-414b-9b42-39935395f67b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f61634f-8a10-414b-9b42-39935395f67b', 'volume_size': 1} Sep 28 17:16:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1030481163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f61634f-8a10-414b-9b42-39935395f67b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918ed0c9482c4c9eb6dbeba2aaa65258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:01Z,use_quota=True,user_id='83cd1226fafa407c974f8d13c152004b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53f9f925-ea53-4c27-b67e-da9decab045f),volume_type_id=53f9f925-ea53-4c27-b67e-da9decab045f)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Creating volume 3f61634f-8a10-414b-9b42-39935395f67b {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:01 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:16:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f61634f-8a10-414b-9b42-39935395f67b 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:01 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f61634f-8a10-414b-9b42-39935395f67b 1073741824 Sep 28 17:16:01 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Flow 'volume_create_manager' (10599e09-a8fc-41cd-b69c-3d493dcd3346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39aec81-7cbc-4da4-99b5-fff7ecfec28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39aec81-7cbc-4da4-99b5-fff7ecfec28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-49739310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022323fc-2eec-4106-8d37-95e7697321d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918ed0c9482c4c9eb6dbeba2aaa65258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:02Z,use_quota=True,user_id='83cd1226fafa407c974f8d13c152004b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2a249b5-3d0f-493f-9fc6-6f310dfbeed0),volume_type_id=a2a249b5-3d0f-493f-9fc6-6f310dfbeed0)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e7a5c4-9976-4375-9965-c5514c040fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e7a5c4-9976-4375-9965-c5514c040fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063b0d4a-7c09-4b37-83aa-d42c6633f38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063b0d4a-7c09-4b37-83aa-d42c6633f38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '022323fc-2eec-4106-8d37-95e7697321d9', 'volume_name': 'volume-022323fc-2eec-4106-8d37-95e7697321d9', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d83dc34-f8ee-4e96-bd5d-7adc04c46466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d83dc34-f8ee-4e96-bd5d-7adc04c46466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ae80b6-8ccf-44b4-880a-bfb01e9cf7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:02 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Volume 022323fc-2eec-4106-8d37-95e7697321d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-022323fc-2eec-4106-8d37-95e7697321d9', 'volume_size': 1} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:02 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f61634f-8a10-414b-9b42-39935395f67b 1073741824" returned: 0 in 0.847s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f61634f-8a10-414b-9b42-39935395f67b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:02 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f61634f-8a10-414b-9b42-39935395f67b Sep 28 17:16:02 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:02 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f61634f-8a10-414b-9b42-39935395f67b" returned: 0 in 0.453s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.614s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-49739310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022323fc-2eec-4106-8d37-95e7697321d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918ed0c9482c4c9eb6dbeba2aaa65258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:02Z,use_quota=True,user_id='83cd1226fafa407c974f8d13c152004b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2a249b5-3d0f-493f-9fc6-6f310dfbeed0),volume_type_id=a2a249b5-3d0f-493f-9fc6-6f310dfbeed0)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Creating volume 022323fc-2eec-4106-8d37-95e7697321d9 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:02 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:16:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-022323fc-2eec-4106-8d37-95e7697321d9 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:03 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-022323fc-2eec-4106-8d37-95e7697321d9 1073741824 Sep 28 17:16:03 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9fc689b-23b8-4eb1-b9b0-ca615b9d6445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f61634f-8a10-414b-9b42-39935395f67b', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8a8f86-6dbd-4855-8828-1941f0e60c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:03 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Volume volume-3f61634f-8a10-414b-9b42-39935395f67b (3f61634f-8a10-414b-9b42-39935395f67b): created successfully Sep 28 17:16:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8a8f86-6dbd-4855-8828-1941f0e60c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Flow 'volume_create_manager' (a452bf0c-0c01-4293-aca7-3958dc1f6a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:03 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-f2d7d629-7712-4452-b758-394f161b4eec tempest-TestInstancesWithCinderVolumes-1653329247 None] Created volume successfully. Sep 28 17:16:03 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Flow 'volume_create_manager' (402128ab-60d5-4547-b824-59eba807b674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20601a6-359d-41ae-be82-6f6b54f8f779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20601a6-359d-41ae-be82-6f6b54f8f779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1591842839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16f117da-7486-4d80-9d8c-32f9ec447b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918ed0c9482c4c9eb6dbeba2aaa65258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:03Z,use_quota=True,user_id='83cd1226fafa407c974f8d13c152004b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15437c5b-5560-451a-89db-b2f3acc88a05),volume_type_id=15437c5b-5560-451a-89db-b2f3acc88a05)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba7e387-58b7-4803-b668-36968816b301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba7e387-58b7-4803-b668-36968816b301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d9426c-432f-4527-858e-90118965bef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:03 devstack cinder-volume[87061]: DEBUG cinder.image.glance [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Creating Keystone auth plugin from conf {{(pid=87061) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:16:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d9426c-432f-4527-858e-90118965bef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '16f117da-7486-4d80-9d8c-32f9ec447b86', 'volume_name': 'volume-16f117da-7486-4d80-9d8c-32f9ec447b86', 'volume_size': 1, 'image_id': '69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--746266415', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '918ed0c9482c4c9eb6dbeba2aaa65258', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe', 'created_at': datetime.datetime(2026, 9, 28, 15, 15, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe/file', 'properties': {}}, 'image_service': }' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9adfccd1-f969-435d-97c0-aab1275399bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9adfccd1-f969-435d-97c0-aab1275399bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4421060-18d9-43c4-a9ee-4eef3d16dd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:03 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Volume 16f117da-7486-4d80-9d8c-32f9ec447b86: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-16f117da-7486-4d80-9d8c-32f9ec447b86', 'volume_size': 1, 'image_id': '69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--746266415', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '918ed0c9482c4c9eb6dbeba2aaa65258', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe', 'created_at': datetime.datetime(2026, 9, 28, 15, 15, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe/file', 'properties': {}}, 'image_service': } Sep 28 17:16:03 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Trying to clone 16f117da-7486-4d80-9d8c-32f9ec447b86 from image 69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe at location (None, [{'url': 'file:///opt/stack/data/glance/images/69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe', 'metadata': {}}]). {{(pid=87061) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:16:03 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-022323fc-2eec-4106-8d37-95e7697321d9 1073741824" returned: 0 in 0.763s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-022323fc-2eec-4106-8d37-95e7697321d9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:03 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-022323fc-2eec-4106-8d37-95e7697321d9 Sep 28 17:16:03 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:04 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-022323fc-2eec-4106-8d37-95e7697321d9" returned: 0 in 0.513s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ae80b6-8ccf-44b4-880a-bfb01e9cf7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-022323fc-2eec-4106-8d37-95e7697321d9', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb8040b-9b38-4b35-b1fa-05b23468b4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:04 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Volume volume-022323fc-2eec-4106-8d37-95e7697321d9 (022323fc-2eec-4106-8d37-95e7697321d9): created successfully Sep 28 17:16:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb8040b-9b38-4b35-b1fa-05b23468b4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Flow 'volume_create_manager' (10599e09-a8fc-41cd-b69c-3d493dcd3346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:04 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-9fad9f64-5d43-4cbd-b534-2d132071f0be tempest-TestInstancesWithCinderVolumes-1653329247 None] Created volume successfully. Sep 28 17:16:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:16:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:06 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:16:06 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:07 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.455s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:16:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:16:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:16:09 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe_742f9wrbdevstack@QuobyteHD, size 20.69 MB, duration 5.50 sec {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:16:09 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Image download 20.69 MB at 3.76 MB/s Sep 28 17:16:09 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd2a1c2-965a-4a05-9cf8-f7d85e8771c0]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe_742f9wrbdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:09 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe_742f9wrbdevstack@QuobyteHD Sep 28 17:16:09 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:09 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe_742f9wrbdevstack@QuobyteHD" returned: 0 in 0.486s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:09 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Temporary image 69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe is fetched for user 83cd1226fafa407c974f8d13c152004b. {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:16:09 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[999a6b95-8b43-48f4-a12d-52a86680618c]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe_742f9wrbdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:10 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe_742f9wrbdevstack@QuobyteHD Sep 28 17:16:10 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:10 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe_742f9wrbdevstack@QuobyteHD" returned: 0 in 0.648s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1591842839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16f117da-7486-4d80-9d8c-32f9ec447b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918ed0c9482c4c9eb6dbeba2aaa65258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:03Z,use_quota=True,user_id='83cd1226fafa407c974f8d13c152004b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15437c5b-5560-451a-89db-b2f3acc88a05),volume_type_id=15437c5b-5560-451a-89db-b2f3acc88a05)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Creating volume 16f117da-7486-4d80-9d8c-32f9ec447b86 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:10 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:16:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-16f117da-7486-4d80-9d8c-32f9ec447b86 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:10 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-16f117da-7486-4d80-9d8c-32f9ec447b86 1073741824 Sep 28 17:16:10 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:11 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-16f117da-7486-4d80-9d8c-32f9ec447b86 1073741824" returned: 0 in 0.684s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-16f117da-7486-4d80-9d8c-32f9ec447b86 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:11 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-16f117da-7486-4d80-9d8c-32f9ec447b86 Sep 28 17:16:11 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:11 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-16f117da-7486-4d80-9d8c-32f9ec447b86" returned: 0 in 0.385s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:11 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Attempting download of 69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe ((None, [{'url': 'file:///opt/stack/data/glance/images/69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe', 'metadata': {}}])) to volume 16f117da-7486-4d80-9d8c-32f9ec447b86. {{(pid=87061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:16:11 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b447f0-7880-4fed-be0b-d72c1bb2be57]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe_1adg2dqd {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:11 devstack sudo[99469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe_1adg2dqd Sep 28 17:16:11 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:12 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe_1adg2dqd" returned: 0 in 0.444s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe_1adg2dqd {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:12 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe_1adg2dqd Sep 28 17:16:12 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:12 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe_1adg2dqd" returned: 1 in 0.470s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe_1adg2dqd' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:16:12 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[688f850d-3720-4ba6-ab95-2d3f32910724]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe_742f9wrbdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:12 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe_742f9wrbdevstack@QuobyteHD Sep 28 17:16:12 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:13 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe_742f9wrbdevstack@QuobyteHD" returned: 0 in 0.607s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:13 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] 69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe was qcow2, converting to qcow2 {{(pid=87061) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:16:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe_742f9wrbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-16f117da-7486-4d80-9d8c-32f9ec447b86 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:13 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe_742f9wrbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-16f117da-7486-4d80-9d8c-32f9ec447b86 Sep 28 17:16:13 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:16 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe_742f9wrbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-16f117da-7486-4d80-9d8c-32f9ec447b86" returned: 0 in 3.320s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:16 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe_742f9wrbdevstack@QuobyteHD, size 112.00 MB, duration 3.32 sec, destination /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-16f117da-7486-4d80-9d8c-32f9ec447b86 {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:16:16 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Converted 112.00 MB image at 33.70 MB/s Sep 28 17:16:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-16f117da-7486-4d80-9d8c-32f9ec447b86 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:16 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-16f117da-7486-4d80-9d8c-32f9ec447b86 1G Sep 28 17:16:16 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:17 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-16f117da-7486-4d80-9d8c-32f9ec447b86 1G" returned: 0 in 0.538s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:17 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Downloaded image 69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe ((None, [{'url': 'file:///opt/stack/data/glance/images/69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe', 'metadata': {}}])) to volume 16f117da-7486-4d80-9d8c-32f9ec447b86 successfully. {{(pid=87061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:16:17 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Temporary image 69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe for user 83cd1226fafa407c974f8d13c152004b is deleted. {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:16:17 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Marking volume 16f117da-7486-4d80-9d8c-32f9ec447b86 as bootable. {{(pid=87061) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:16:17 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Copying metadata from image 69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe to 16f117da-7486-4d80-9d8c-32f9ec447b86. {{(pid=87061) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:16:17 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Creating volume glance metadata for volume 16f117da-7486-4d80-9d8c-32f9ec447b86 backed by image 69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe with: {'image_id': '69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe', 'image_name': 'tempest-scenario-img--746266415', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87061) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:16:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4421060-18d9-43c4-a9ee-4eef3d16dd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16f117da-7486-4d80-9d8c-32f9ec447b86', 'volume_size': 1, 'image_id': '69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--746266415', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '918ed0c9482c4c9eb6dbeba2aaa65258', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe', 'created_at': datetime.datetime(2026, 9, 28, 15, 15, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69cd7ff4-bac9-46e2-9f05-c71e6fc3aefe/file', 'properties': {}}, 'image_service': }' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb97419-857c-4ee2-a9d7-f4c507906a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:17 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Volume volume-16f117da-7486-4d80-9d8c-32f9ec447b86 (16f117da-7486-4d80-9d8c-32f9ec447b86): created successfully Sep 28 17:16:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb97419-857c-4ee2-a9d7-f4c507906a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Flow 'volume_create_manager' (402128ab-60d5-4547-b824-59eba807b674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:17 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a0dd9276-3c8b-4309-b61f-bc2011d79637 tempest-TestInstancesWithCinderVolumes-1653329247 None] Created volume successfully. Sep 28 17:16:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-e914bebb-9842-4e65-ba28-6fb8783c2688 req-be9623b7-1ebe-4ecf-9af4-c477d31358b4 tempest-TestInstancesWithCinderVolumes-1653329247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-e914bebb-9842-4e65-ba28-6fb8783c2688 req-be9623b7-1ebe-4ecf-9af4-c477d31358b4 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-e914bebb-9842-4e65-ba28-6fb8783c2688 req-be9623b7-1ebe-4ecf-9af4-c477d31358b4 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-e914bebb-9842-4e65-ba28-6fb8783c2688 req-be9623b7-1ebe-4ecf-9af4-c477d31358b4 tempest-TestInstancesWithCinderVolumes-1653329247 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-16f117da-7486-4d80-9d8c-32f9ec447b86', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dfa38472-e9fc-43b9-bc68-50032f664294', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:16:26 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-e914bebb-9842-4e65-ba28-6fb8783c2688 req-be9623b7-1ebe-4ecf-9af4-c477d31358b4 tempest-TestInstancesWithCinderVolumes-1653329247 None] attachment_update completed successfully. Sep 28 17:16:32 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Flow 'volume_create_manager' (2830769a-72ce-4367-8ae5-45f5bafdd6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65645b4b-7fad-4e25-b494-86f1329acdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65645b4b-7fad-4e25-b494-86f1329acdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1282624097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ec503b-1aca-4aba-ad0a-00344efe8232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b2bc98caf9747dab6a20322e6d50dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:33Z,use_quota=True,user_id='475f5b6f593b4a689a0924add3e47a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689b5f27-0f2e-4759-8278-de1e52cb3429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689b5f27-0f2e-4759-8278-de1e52cb3429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43d8db8-5568-434a-9142-da111b28367f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43d8db8-5568-434a-9142-da111b28367f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0ec503b-1aca-4aba-ad0a-00344efe8232', 'volume_name': 'volume-f0ec503b-1aca-4aba-ad0a-00344efe8232', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1970452-17cd-421e-99d7-5ab21123a1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1970452-17cd-421e-99d7-5ab21123a1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ba5960-456c-4580-9ed6-2873999eae52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:32 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Volume f0ec503b-1aca-4aba-ad0a-00344efe8232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0ec503b-1aca-4aba-ad0a-00344efe8232', 'volume_size': 1} Sep 28 17:16:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1282624097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ec503b-1aca-4aba-ad0a-00344efe8232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b2bc98caf9747dab6a20322e6d50dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:33Z,use_quota=True,user_id='475f5b6f593b4a689a0924add3e47a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Creating volume f0ec503b-1aca-4aba-ad0a-00344efe8232 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:32 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:16:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f0ec503b-1aca-4aba-ad0a-00344efe8232 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:32 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f0ec503b-1aca-4aba-ad0a-00344efe8232 1073741824 Sep 28 17:16:32 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:33 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f0ec503b-1aca-4aba-ad0a-00344efe8232 1073741824" returned: 0 in 0.724s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f0ec503b-1aca-4aba-ad0a-00344efe8232 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:33 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f0ec503b-1aca-4aba-ad0a-00344efe8232 Sep 28 17:16:33 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:33 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f0ec503b-1aca-4aba-ad0a-00344efe8232" returned: 0 in 0.329s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:33 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ba5960-456c-4580-9ed6-2873999eae52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0ec503b-1aca-4aba-ad0a-00344efe8232', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984203e0-40b3-41d7-be8d-2f2af7888f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:33 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Volume volume-f0ec503b-1aca-4aba-ad0a-00344efe8232 (f0ec503b-1aca-4aba-ad0a-00344efe8232): created successfully Sep 28 17:16:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984203e0-40b3-41d7-be8d-2f2af7888f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Flow 'volume_create_manager' (2830769a-72ce-4367-8ae5-45f5bafdd6d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:34 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-02936890-aecf-4416-952a-2dec508c8d58 tempest-TestMinimumBasicScenario-1300733889 None] Created volume successfully. Sep 28 17:16:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-de6c156f-43cd-4be1-b765-2ba0b8b8e282 req-08f38cf9-367b-4b0a-96e0-20adb703aab9 tempest-TestMinimumBasicScenario-1300733889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-de6c156f-43cd-4be1-b765-2ba0b8b8e282 req-08f38cf9-367b-4b0a-96e0-20adb703aab9 tempest-TestMinimumBasicScenario-1300733889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-de6c156f-43cd-4be1-b765-2ba0b8b8e282 req-08f38cf9-367b-4b0a-96e0-20adb703aab9 tempest-TestMinimumBasicScenario-1300733889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-de6c156f-43cd-4be1-b765-2ba0b8b8e282 req-08f38cf9-367b-4b0a-96e0-20adb703aab9 tempest-TestMinimumBasicScenario-1300733889 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-f0ec503b-1aca-4aba-ad0a-00344efe8232', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61e8e130-8535-45ff-bde9-59ca0be7359b', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:16:36 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-de6c156f-43cd-4be1-b765-2ba0b8b8e282 req-08f38cf9-367b-4b0a-96e0-20adb703aab9 tempest-TestMinimumBasicScenario-1300733889 None] attachment_update completed successfully. Sep 28 17:16:46 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:UPDATE=23,cinder:SELECT=37,cinder:DELETE=2,cinder:INSERT=7 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:16:52 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=34,cinder:INSERT=7,cinder:UPDATE=20,cinder:DELETE=3 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:16:54 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-3f054008-f565-4a30-a1e0-b5fe694065cf req-23653670-9cf2-47f0-96e6-5014504d1512 tempest-AttachVolumeNegativeTest-648762481 None] Terminate volume connection completed successfully. Sep 28 17:16:54 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-3f054008-f565-4a30-a1e0-b5fe694065cf req-23653670-9cf2-47f0-96e6-5014504d1512 tempest-AttachVolumeNegativeTest-648762481 None] Deleting attachment 4a79a5fb-3af8-49cc-803d-8d0f875f4e0e. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:17:04 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=2 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:17:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:17:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:06 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:17:06 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:07 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.530s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:17:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:17:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:17:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-7b9e34f9-d046-4590-98b6-de1c82db86fe req-bb32826f-844f-442d-82b5-cd2222f26105 tempest-TestInstancesWithCinderVolumes-1653329247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-7b9e34f9-d046-4590-98b6-de1c82db86fe req-bb32826f-844f-442d-82b5-cd2222f26105 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-7b9e34f9-d046-4590-98b6-de1c82db86fe req-bb32826f-844f-442d-82b5-cd2222f26105 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:11 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-7b9e34f9-d046-4590-98b6-de1c82db86fe req-bb32826f-844f-442d-82b5-cd2222f26105 tempest-TestInstancesWithCinderVolumes-1653329247 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-3f61634f-8a10-414b-9b42-39935395f67b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5403083-eea2-4078-af8d-5e7abd78bf23', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:17:11 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-7b9e34f9-d046-4590-98b6-de1c82db86fe req-bb32826f-844f-442d-82b5-cd2222f26105 tempest-TestInstancesWithCinderVolumes-1653329247 None] attachment_update completed successfully. Sep 28 17:17:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-8cb02cd8-9c7e-4f1f-bedb-ac40fcc06692 req-b3ad866f-3771-42cd-86a7-937f2837a170 tempest-TestInstancesWithCinderVolumes-1653329247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-8cb02cd8-9c7e-4f1f-bedb-ac40fcc06692 req-b3ad866f-3771-42cd-86a7-937f2837a170 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-8cb02cd8-9c7e-4f1f-bedb-ac40fcc06692 req-b3ad866f-3771-42cd-86a7-937f2837a170 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-8cb02cd8-9c7e-4f1f-bedb-ac40fcc06692 req-b3ad866f-3771-42cd-86a7-937f2837a170 tempest-TestInstancesWithCinderVolumes-1653329247 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-022323fc-2eec-4106-8d37-95e7697321d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b46d070-f4be-4273-8fd7-3c9e125c5948', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:17:15 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-8cb02cd8-9c7e-4f1f-bedb-ac40fcc06692 req-b3ad866f-3771-42cd-86a7-937f2837a170 tempest-TestInstancesWithCinderVolumes-1653329247 None] attachment_update completed successfully. Sep 28 17:17:22 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-c429edd6-ad5a-4b9a-bf0e-85611f60c89f req-363c306b-317a-4547-8ff6-7b3fdb035df5 tempest-TestInstancesWithCinderVolumes-1653329247 None] Terminate volume connection completed successfully. Sep 28 17:17:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-c429edd6-ad5a-4b9a-bf0e-85611f60c89f req-363c306b-317a-4547-8ff6-7b3fdb035df5 tempest-TestInstancesWithCinderVolumes-1653329247 None] Deleting attachment a5403083-eea2-4078-af8d-5e7abd78bf23. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:17:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c6644986-ef04-438e-a8d2-16e83a03ebe2 tempest-TestInstancesWithCinderVolumes-1653329247 None] Acquiring lock "cinder-3f61634f-8a10-414b-9b42-39935395f67b-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c6644986-ef04-438e-a8d2-16e83a03ebe2 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "cinder-3f61634f-8a10-414b-9b42-39935395f67b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c6644986-ef04-438e-a8d2-16e83a03ebe2 tempest-TestInstancesWithCinderVolumes-1653329247 None] Acquiring lock "cinder-quobyte-3f61634f-8a10-414b-9b42-39935395f67b" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c6644986-ef04-438e-a8d2-16e83a03ebe2 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "cinder-quobyte-3f61634f-8a10-414b-9b42-39935395f67b" acquired by "delete_volume" :: waited 0.017s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:23 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c0dd34-a49d-485d-874c-d0ed8c45d418]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c6644986-ef04-438e-a8d2-16e83a03ebe2 tempest-TestInstancesWithCinderVolumes-1653329247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f61634f-8a10-414b-9b42-39935395f67b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:23 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f61634f-8a10-414b-9b42-39935395f67b Sep 28 17:17:23 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:24 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c6644986-ef04-438e-a8d2-16e83a03ebe2 tempest-TestInstancesWithCinderVolumes-1653329247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f61634f-8a10-414b-9b42-39935395f67b" returned: 0 in 0.592s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c6644986-ef04-438e-a8d2-16e83a03ebe2 tempest-TestInstancesWithCinderVolumes-1653329247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f61634f-8a10-414b-9b42-39935395f67b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:24 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f61634f-8a10-414b-9b42-39935395f67b Sep 28 17:17:24 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:24 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c6644986-ef04-438e-a8d2-16e83a03ebe2 tempest-TestInstancesWithCinderVolumes-1653329247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3f61634f-8a10-414b-9b42-39935395f67b" returned: 0 in 0.378s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c6644986-ef04-438e-a8d2-16e83a03ebe2 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "cinder-quobyte-3f61634f-8a10-414b-9b42-39935395f67b" released by "delete_volume" :: held 1.035s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:24 devstack cinder-volume[87061]: WARNING cinder.quota [None req-c6644986-ef04-438e-a8d2-16e83a03ebe2 tempest-TestInstancesWithCinderVolumes-1653329247 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1531480409-145305517 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1531480409-145305517, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:17:24 devstack cinder-volume[87061]: WARNING cinder.quota [None req-c6644986-ef04-438e-a8d2-16e83a03ebe2 tempest-TestInstancesWithCinderVolumes-1653329247 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1531480409-145305517 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1531480409-145305517, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:17:24 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-c6644986-ef04-438e-a8d2-16e83a03ebe2 tempest-TestInstancesWithCinderVolumes-1653329247 None] Created reservations ['ba771ec8-92b8-4adb-b6bf-05eeca797c2e', 'a45ed06f-0b68-4b93-ac4f-d94371ac7806', '187fad28-682e-4efa-85ab-ee3a7fef472c', '259c2bed-67ae-43f7-9f6f-d635240508d2'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c6644986-ef04-438e-a8d2-16e83a03ebe2 tempest-TestInstancesWithCinderVolumes-1653329247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c6644986-ef04-438e-a8d2-16e83a03ebe2 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c6644986-ef04-438e-a8d2-16e83a03ebe2 tempest-TestInstancesWithCinderVolumes-1653329247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c6644986-ef04-438e-a8d2-16e83a03ebe2 tempest-TestInstancesWithCinderVolumes-1653329247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c6644986-ef04-438e-a8d2-16e83a03ebe2 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c6644986-ef04-438e-a8d2-16e83a03ebe2 tempest-TestInstancesWithCinderVolumes-1653329247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:24 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:17:24 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:25 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c6644986-ef04-438e-a8d2-16e83a03ebe2 tempest-TestInstancesWithCinderVolumes-1653329247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.349s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:25 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-c6644986-ef04-438e-a8d2-16e83a03ebe2 tempest-TestInstancesWithCinderVolumes-1653329247 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:25 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-c6644986-ef04-438e-a8d2-16e83a03ebe2 tempest-TestInstancesWithCinderVolumes-1653329247 None] Deleted volume successfully. Sep 28 17:17:25 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c6644986-ef04-438e-a8d2-16e83a03ebe2 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "cinder-3f61634f-8a10-414b-9b42-39935395f67b-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:28 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-26f97e03-a5e3-485e-bce0-229ed2fc7b39 req-d4e4d6e8-c843-4b60-b351-c25207822f78 tempest-TestInstancesWithCinderVolumes-1653329247 None] Terminate volume connection completed successfully. Sep 28 17:17:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-26f97e03-a5e3-485e-bce0-229ed2fc7b39 req-d4e4d6e8-c843-4b60-b351-c25207822f78 tempest-TestInstancesWithCinderVolumes-1653329247 None] Deleting attachment 6b46d070-f4be-4273-8fd7-3c9e125c5948. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:17:29 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-eb4eee55-5cd5-4c20-a03d-a97c45701b4f req-4f2622c1-4126-4ee2-a277-324e1dd7bd1a tempest-TestMinimumBasicScenario-1300733889 None] Terminate volume connection completed successfully. Sep 28 17:17:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-eb4eee55-5cd5-4c20-a03d-a97c45701b4f req-4f2622c1-4126-4ee2-a277-324e1dd7bd1a tempest-TestMinimumBasicScenario-1300733889 None] Deleting attachment 61e8e130-8535-45ff-bde9-59ca0be7359b. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:17:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-da33685d-2da8-452f-b430-6bdf2e8f6469 tempest-TestMinimumBasicScenario-1300733889 None] Acquiring lock "cinder-f0ec503b-1aca-4aba-ad0a-00344efe8232-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-da33685d-2da8-452f-b430-6bdf2e8f6469 tempest-TestMinimumBasicScenario-1300733889 None] Lock "cinder-f0ec503b-1aca-4aba-ad0a-00344efe8232-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-da33685d-2da8-452f-b430-6bdf2e8f6469 tempest-TestMinimumBasicScenario-1300733889 None] Acquiring lock "cinder-quobyte-f0ec503b-1aca-4aba-ad0a-00344efe8232" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-da33685d-2da8-452f-b430-6bdf2e8f6469 tempest-TestMinimumBasicScenario-1300733889 None] Lock "cinder-quobyte-f0ec503b-1aca-4aba-ad0a-00344efe8232" acquired by "delete_volume" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:30 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2f3873-c5a5-47b3-a02b-c85083104af7]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-da33685d-2da8-452f-b430-6bdf2e8f6469 tempest-TestMinimumBasicScenario-1300733889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f0ec503b-1aca-4aba-ad0a-00344efe8232 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-b808ffb6-69c9-4f75-95e4-172f32375cf7 tempest-TestInstancesWithCinderVolumes-1653329247 None] Acquiring lock "cinder-022323fc-2eec-4106-8d37-95e7697321d9-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-b808ffb6-69c9-4f75-95e4-172f32375cf7 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "cinder-022323fc-2eec-4106-8d37-95e7697321d9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-b808ffb6-69c9-4f75-95e4-172f32375cf7 tempest-TestInstancesWithCinderVolumes-1653329247 None] Acquiring lock "cinder-quobyte-022323fc-2eec-4106-8d37-95e7697321d9" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-b808ffb6-69c9-4f75-95e4-172f32375cf7 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "cinder-quobyte-022323fc-2eec-4106-8d37-95e7697321d9" acquired by "delete_volume" :: waited 0.026s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:30 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f0ec503b-1aca-4aba-ad0a-00344efe8232 Sep 28 17:17:30 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:30 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0c1141-1796-4d95-a6b3-678eeea82074]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b808ffb6-69c9-4f75-95e4-172f32375cf7 tempest-TestInstancesWithCinderVolumes-1653329247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-022323fc-2eec-4106-8d37-95e7697321d9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:30 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-022323fc-2eec-4106-8d37-95e7697321d9 Sep 28 17:17:30 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:30 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-da33685d-2da8-452f-b430-6bdf2e8f6469 tempest-TestMinimumBasicScenario-1300733889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f0ec503b-1aca-4aba-ad0a-00344efe8232" returned: 0 in 0.501s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-da33685d-2da8-452f-b430-6bdf2e8f6469 tempest-TestMinimumBasicScenario-1300733889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f0ec503b-1aca-4aba-ad0a-00344efe8232 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:30 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f0ec503b-1aca-4aba-ad0a-00344efe8232 Sep 28 17:17:31 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:31 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b808ffb6-69c9-4f75-95e4-172f32375cf7 tempest-TestInstancesWithCinderVolumes-1653329247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-022323fc-2eec-4106-8d37-95e7697321d9" returned: 0 in 0.517s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b808ffb6-69c9-4f75-95e4-172f32375cf7 tempest-TestInstancesWithCinderVolumes-1653329247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-022323fc-2eec-4106-8d37-95e7697321d9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:31 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-022323fc-2eec-4106-8d37-95e7697321d9 Sep 28 17:17:31 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:31 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-da33685d-2da8-452f-b430-6bdf2e8f6469 tempest-TestMinimumBasicScenario-1300733889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f0ec503b-1aca-4aba-ad0a-00344efe8232" returned: 0 in 0.320s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-da33685d-2da8-452f-b430-6bdf2e8f6469 tempest-TestMinimumBasicScenario-1300733889 None] Lock "cinder-quobyte-f0ec503b-1aca-4aba-ad0a-00344efe8232" released by "delete_volume" :: held 0.881s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-da33685d-2da8-452f-b430-6bdf2e8f6469 tempest-TestMinimumBasicScenario-1300733889 None] Created reservations ['8f0e7047-f4fd-4ed4-85da-74997a5d3d29', '18e102ec-111c-403c-a187-cbc33a779bdd', '710de6b9-8387-475d-8fc7-67e025fc8f43', '7b9891b7-a850-47f3-90d4-54317475e67d'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-da33685d-2da8-452f-b430-6bdf2e8f6469 tempest-TestMinimumBasicScenario-1300733889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-da33685d-2da8-452f-b430-6bdf2e8f6469 tempest-TestMinimumBasicScenario-1300733889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-da33685d-2da8-452f-b430-6bdf2e8f6469 tempest-TestMinimumBasicScenario-1300733889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:31 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-da33685d-2da8-452f-b430-6bdf2e8f6469 tempest-TestMinimumBasicScenario-1300733889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-da33685d-2da8-452f-b430-6bdf2e8f6469 tempest-TestMinimumBasicScenario-1300733889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-da33685d-2da8-452f-b430-6bdf2e8f6469 tempest-TestMinimumBasicScenario-1300733889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b808ffb6-69c9-4f75-95e4-172f32375cf7 tempest-TestInstancesWithCinderVolumes-1653329247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-022323fc-2eec-4106-8d37-95e7697321d9" returned: 0 in 0.360s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-b808ffb6-69c9-4f75-95e4-172f32375cf7 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "cinder-quobyte-022323fc-2eec-4106-8d37-95e7697321d9" released by "delete_volume" :: held 0.940s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:31 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:17:31 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:31 devstack cinder-volume[87061]: WARNING cinder.quota [None req-b808ffb6-69c9-4f75-95e4-172f32375cf7 tempest-TestInstancesWithCinderVolumes-1653329247 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1529497533-1111862653 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1529497533-1111862653, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:17:31 devstack cinder-volume[87061]: WARNING cinder.quota [None req-b808ffb6-69c9-4f75-95e4-172f32375cf7 tempest-TestInstancesWithCinderVolumes-1653329247 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1529497533-1111862653 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1529497533-1111862653, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-b808ffb6-69c9-4f75-95e4-172f32375cf7 tempest-TestInstancesWithCinderVolumes-1653329247 None] Created reservations ['41e21589-dda3-425c-861e-6097c7046bce', '014aa2eb-7b66-4b21-ad1e-afed9f8efeb5', 'b780bc80-2066-4588-8777-3141750f4fce', '92a86fdc-59c3-412e-b334-64af6466fbc8'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b808ffb6-69c9-4f75-95e4-172f32375cf7 tempest-TestInstancesWithCinderVolumes-1653329247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b808ffb6-69c9-4f75-95e4-172f32375cf7 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b808ffb6-69c9-4f75-95e4-172f32375cf7 tempest-TestInstancesWithCinderVolumes-1653329247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b808ffb6-69c9-4f75-95e4-172f32375cf7 tempest-TestInstancesWithCinderVolumes-1653329247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b808ffb6-69c9-4f75-95e4-172f32375cf7 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b808ffb6-69c9-4f75-95e4-172f32375cf7 tempest-TestInstancesWithCinderVolumes-1653329247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:31 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:17:31 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:31 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-da33685d-2da8-452f-b430-6bdf2e8f6469 tempest-TestMinimumBasicScenario-1300733889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.419s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-da33685d-2da8-452f-b430-6bdf2e8f6469 tempest-TestMinimumBasicScenario-1300733889 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:31 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-da33685d-2da8-452f-b430-6bdf2e8f6469 tempest-TestMinimumBasicScenario-1300733889 None] Deleted volume successfully. Sep 28 17:17:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-da33685d-2da8-452f-b430-6bdf2e8f6469 tempest-TestMinimumBasicScenario-1300733889 None] Lock "cinder-f0ec503b-1aca-4aba-ad0a-00344efe8232-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:32 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b808ffb6-69c9-4f75-95e4-172f32375cf7 tempest-TestInstancesWithCinderVolumes-1653329247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.401s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:32 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-b808ffb6-69c9-4f75-95e4-172f32375cf7 tempest-TestInstancesWithCinderVolumes-1653329247 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:32 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-b808ffb6-69c9-4f75-95e4-172f32375cf7 tempest-TestInstancesWithCinderVolumes-1653329247 None] Deleted volume successfully. Sep 28 17:17:32 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-b808ffb6-69c9-4f75-95e4-172f32375cf7 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "cinder-022323fc-2eec-4106-8d37-95e7697321d9-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:37 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-cbd85335-ecad-4003-aa23-9f9340b98024 req-5632c5c4-dd43-444d-bb6c-b2a6ed12184f tempest-TestInstancesWithCinderVolumes-1653329247 None] Terminate volume connection completed successfully. Sep 28 17:17:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-cbd85335-ecad-4003-aa23-9f9340b98024 req-5632c5c4-dd43-444d-bb6c-b2a6ed12184f tempest-TestInstancesWithCinderVolumes-1653329247 None] Deleting attachment dfa38472-e9fc-43b9-bc68-50032f664294. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:17:37 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Flow 'volume_create_manager' (d58fd2e0-8a83-4b64-ba1b-2cbcd6b82475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb1fb5c-820f-454a-a352-6664a1ab2429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb1fb5c-820f-454a-a352-6664a1ab2429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1061146388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2ed6588-453d-4355-90c9-1e8a15f0f5f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3934e9248fa84fb7ba6094a5346f36cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:38Z,use_quota=True,user_id='a74c5dfd1b034b25bef3aba6bd86e3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4901df-8831-491f-8fd4-d31d0530babd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4901df-8831-491f-8fd4-d31d0530babd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b162fa2-9bb5-458e-887e-8c72b11eedb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b162fa2-9bb5-458e-887e-8c72b11eedb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2ed6588-453d-4355-90c9-1e8a15f0f5f1', 'volume_name': 'volume-b2ed6588-453d-4355-90c9-1e8a15f0f5f1', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1929bbb0-3621-42ef-9824-2ed6aba4f745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1929bbb0-3621-42ef-9824-2ed6aba4f745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a68ade90-de60-40ef-bb93-45b4704db678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:38 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Volume b2ed6588-453d-4355-90c9-1e8a15f0f5f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2ed6588-453d-4355-90c9-1e8a15f0f5f1', 'volume_size': 1} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1061146388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2ed6588-453d-4355-90c9-1e8a15f0f5f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3934e9248fa84fb7ba6094a5346f36cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:38Z,use_quota=True,user_id='a74c5dfd1b034b25bef3aba6bd86e3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Creating volume b2ed6588-453d-4355-90c9-1e8a15f0f5f1 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:38 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b2ed6588-453d-4355-90c9-1e8a15f0f5f1 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:38 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b2ed6588-453d-4355-90c9-1e8a15f0f5f1 1073741824 Sep 28 17:17:38 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ac464384-dbc1-4f40-b1ba-9078c9102c33 tempest-TestInstancesWithCinderVolumes-1653329247 None] Acquiring lock "cinder-16f117da-7486-4d80-9d8c-32f9ec447b86-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ac464384-dbc1-4f40-b1ba-9078c9102c33 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "cinder-16f117da-7486-4d80-9d8c-32f9ec447b86-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ac464384-dbc1-4f40-b1ba-9078c9102c33 tempest-TestInstancesWithCinderVolumes-1653329247 None] Acquiring lock "cinder-quobyte-16f117da-7486-4d80-9d8c-32f9ec447b86" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ac464384-dbc1-4f40-b1ba-9078c9102c33 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "cinder-quobyte-16f117da-7486-4d80-9d8c-32f9ec447b86" acquired by "delete_volume" :: waited 0.024s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e1189a-8517-4138-ac85-a50fd021ac97]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ac464384-dbc1-4f40-b1ba-9078c9102c33 tempest-TestInstancesWithCinderVolumes-1653329247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-16f117da-7486-4d80-9d8c-32f9ec447b86 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:38 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-16f117da-7486-4d80-9d8c-32f9ec447b86 Sep 28 17:17:38 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:38 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b2ed6588-453d-4355-90c9-1e8a15f0f5f1 1073741824" returned: 0 in 0.721s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b2ed6588-453d-4355-90c9-1e8a15f0f5f1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:38 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b2ed6588-453d-4355-90c9-1e8a15f0f5f1 Sep 28 17:17:38 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:39 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ac464384-dbc1-4f40-b1ba-9078c9102c33 tempest-TestInstancesWithCinderVolumes-1653329247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-16f117da-7486-4d80-9d8c-32f9ec447b86" returned: 0 in 0.607s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ac464384-dbc1-4f40-b1ba-9078c9102c33 tempest-TestInstancesWithCinderVolumes-1653329247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-16f117da-7486-4d80-9d8c-32f9ec447b86 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:39 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-16f117da-7486-4d80-9d8c-32f9ec447b86 Sep 28 17:17:39 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:39 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b2ed6588-453d-4355-90c9-1e8a15f0f5f1" returned: 0 in 0.450s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:39 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a68ade90-de60-40ef-bb93-45b4704db678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2ed6588-453d-4355-90c9-1e8a15f0f5f1', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:39 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205b1d32-36d0-4a2b-8b48-6037211aad15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:39 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Volume volume-b2ed6588-453d-4355-90c9-1e8a15f0f5f1 (b2ed6588-453d-4355-90c9-1e8a15f0f5f1): created successfully Sep 28 17:17:39 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205b1d32-36d0-4a2b-8b48-6037211aad15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:39 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Flow 'volume_create_manager' (d58fd2e0-8a83-4b64-ba1b-2cbcd6b82475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:39 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-faf61cae-06c3-438d-9432-d0955c1f8e14 tempest-AttachVolumeNegativeTest-648762481 None] Created volume successfully. Sep 28 17:17:39 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ac464384-dbc1-4f40-b1ba-9078c9102c33 tempest-TestInstancesWithCinderVolumes-1653329247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-16f117da-7486-4d80-9d8c-32f9ec447b86" returned: 0 in 0.301s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ac464384-dbc1-4f40-b1ba-9078c9102c33 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "cinder-quobyte-16f117da-7486-4d80-9d8c-32f9ec447b86" released by "delete_volume" :: held 0.979s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:39 devstack cinder-volume[87061]: WARNING cinder.quota [None req-ac464384-dbc1-4f40-b1ba-9078c9102c33 tempest-TestInstancesWithCinderVolumes-1653329247 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-493003182-987523016 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-493003182-987523016, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:17:39 devstack cinder-volume[87061]: WARNING cinder.quota [None req-ac464384-dbc1-4f40-b1ba-9078c9102c33 tempest-TestInstancesWithCinderVolumes-1653329247 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-493003182-987523016 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-493003182-987523016, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:17:39 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-ac464384-dbc1-4f40-b1ba-9078c9102c33 tempest-TestInstancesWithCinderVolumes-1653329247 None] Created reservations ['00d68691-2edb-4623-8d39-1c4654eff770', 'c8f1d0a5-4163-49a5-af88-76d176b08af6', 'cab30ebc-e52c-4947-96c0-fc5c1416c710', 'ba451759-3017-4f60-9974-36481b8218b5'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ac464384-dbc1-4f40-b1ba-9078c9102c33 tempest-TestInstancesWithCinderVolumes-1653329247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ac464384-dbc1-4f40-b1ba-9078c9102c33 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ac464384-dbc1-4f40-b1ba-9078c9102c33 tempest-TestInstancesWithCinderVolumes-1653329247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ac464384-dbc1-4f40-b1ba-9078c9102c33 tempest-TestInstancesWithCinderVolumes-1653329247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ac464384-dbc1-4f40-b1ba-9078c9102c33 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ac464384-dbc1-4f40-b1ba-9078c9102c33 tempest-TestInstancesWithCinderVolumes-1653329247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:39 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:17:39 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:40 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ac464384-dbc1-4f40-b1ba-9078c9102c33 tempest-TestInstancesWithCinderVolumes-1653329247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.329s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:40 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-ac464384-dbc1-4f40-b1ba-9078c9102c33 tempest-TestInstancesWithCinderVolumes-1653329247 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:40 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-ac464384-dbc1-4f40-b1ba-9078c9102c33 tempest-TestInstancesWithCinderVolumes-1653329247 None] Deleted volume successfully. Sep 28 17:17:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ac464384-dbc1-4f40-b1ba-9078c9102c33 tempest-TestInstancesWithCinderVolumes-1653329247 None] Lock "cinder-16f117da-7486-4d80-9d8c-32f9ec447b86-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-50a037a3-8f65-4330-8483-5667914cc767 req-b39ad8e0-3f38-400b-b6cd-27588396ddae tempest-AttachVolumeNegativeTest-648762481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-50a037a3-8f65-4330-8483-5667914cc767 req-b39ad8e0-3f38-400b-b6cd-27588396ddae tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-50a037a3-8f65-4330-8483-5667914cc767 req-b39ad8e0-3f38-400b-b6cd-27588396ddae tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-50a037a3-8f65-4330-8483-5667914cc767 req-b39ad8e0-3f38-400b-b6cd-27588396ddae tempest-AttachVolumeNegativeTest-648762481 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-b2ed6588-453d-4355-90c9-1e8a15f0f5f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a98e8276-a258-45f4-8787-87f24d716b59', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:17:41 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-50a037a3-8f65-4330-8483-5667914cc767 req-b39ad8e0-3f38-400b-b6cd-27588396ddae tempest-AttachVolumeNegativeTest-648762481 None] attachment_update completed successfully. Sep 28 17:17:44 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-f592389a-d9d2-46c1-a790-99a8fb676659 req-ba38d261-7b00-433e-8be4-7bee8f3b616e tempest-AttachVolumeNegativeTest-648762481 None] Terminate volume connection completed successfully. Sep 28 17:17:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-f592389a-d9d2-46c1-a790-99a8fb676659 req-ba38d261-7b00-433e-8be4-7bee8f3b616e tempest-AttachVolumeNegativeTest-648762481 None] Deleting attachment a98e8276-a258-45f4-8787-87f24d716b59. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:17:51 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=46,cinder:UPDATE=43,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:17:54 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=47,cinder:UPDATE=36,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:18:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:18:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:06 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:18:06 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:07 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.499s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:18:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:18:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:18:41 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Flow 'volume_create_manager' (7148a4c4-736b-47be-ad0c-5add17cca6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eae5b8a-b822-45ab-85a9-832273a3ac2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eae5b8a-b822-45ab-85a9-832273a3ac2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1401597260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196b417e-7d23-4af6-aa8c-2d1346c25dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a33f574a5c8d4815a976648b3b1d9cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:41Z,use_quota=True,user_id='6b7dd0fe96c9419b9c2edc49eb23bdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d63fdb9-364d-4f00-9002-a8ddbc8c0cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d63fdb9-364d-4f00-9002-a8ddbc8c0cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc091ac-7169-4cb6-97dd-927eb23431ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:41 devstack cinder-volume[87061]: DEBUG cinder.image.glance [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Creating Keystone auth plugin from conf {{(pid=87061) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:18:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc091ac-7169-4cb6-97dd-927eb23431ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '196b417e-7d23-4af6-aa8c-2d1346c25dad', 'volume_name': 'volume-196b417e-7d23-4af6-aa8c-2d1346c25dad', 'volume_size': 1, 'image_id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21d27c6a4ac749c0a5b3cbd558b3b102', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'created_at': datetime.datetime(2026, 9, 28, 14, 57, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3da6edc3-4055-4154-be43-a897ff97d7cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f34a0a-e636-436c-8c55-22a4f5eda86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f34a0a-e636-436c-8c55-22a4f5eda86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb40d2f-28d9-49ef-b086-9040d17a23d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:42 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Volume 196b417e-7d23-4af6-aa8c-2d1346c25dad: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-196b417e-7d23-4af6-aa8c-2d1346c25dad', 'volume_size': 1, 'image_id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21d27c6a4ac749c0a5b3cbd558b3b102', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'created_at': datetime.datetime(2026, 9, 28, 14, 57, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3da6edc3-4055-4154-be43-a897ff97d7cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:18:42 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Trying to clone 196b417e-7d23-4af6-aa8c-2d1346c25dad from image 3da6edc3-4055-4154-be43-a897ff97d7cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}]). {{(pid=87061) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:18:43 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_hcdphzgsdevstack@QuobyteHD, size 20.69 MB, duration 1.07 sec {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:18:43 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Image download 20.69 MB at 19.29 MB/s Sep 28 17:18:43 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7b0d25-4eb7-4cba-8e5f-8f11e2b9b290]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_hcdphzgsdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:44 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_hcdphzgsdevstack@QuobyteHD Sep 28 17:18:44 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:44 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_hcdphzgsdevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:44 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Temporary image 3da6edc3-4055-4154-be43-a897ff97d7cf is fetched for user 6b7dd0fe96c9419b9c2edc49eb23bdcc. {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:18:44 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb62ed3d-9afe-42bc-970a-b711c46f46d7]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_hcdphzgsdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:44 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_hcdphzgsdevstack@QuobyteHD Sep 28 17:18:44 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:45 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_hcdphzgsdevstack@QuobyteHD" returned: 0 in 0.466s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1401597260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196b417e-7d23-4af6-aa8c-2d1346c25dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a33f574a5c8d4815a976648b3b1d9cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:41Z,use_quota=True,user_id='6b7dd0fe96c9419b9c2edc49eb23bdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:18:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Creating volume 196b417e-7d23-4af6-aa8c-2d1346c25dad {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:18:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:45 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:18:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-196b417e-7d23-4af6-aa8c-2d1346c25dad 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:45 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-196b417e-7d23-4af6-aa8c-2d1346c25dad 1073741824 Sep 28 17:18:45 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:45 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-196b417e-7d23-4af6-aa8c-2d1346c25dad 1073741824" returned: 0 in 0.677s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-196b417e-7d23-4af6-aa8c-2d1346c25dad {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:45 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-196b417e-7d23-4af6-aa8c-2d1346c25dad Sep 28 17:18:45 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:46 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-196b417e-7d23-4af6-aa8c-2d1346c25dad" returned: 0 in 0.522s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:46 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Attempting download of 3da6edc3-4055-4154-be43-a897ff97d7cf ((None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}])) to volume 196b417e-7d23-4af6-aa8c-2d1346c25dad. {{(pid=87061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:18:46 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b94565-83c8-4403-86e1-60bf37909f57]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_ah26kr54 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:46 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_ah26kr54 Sep 28 17:18:46 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:46 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_ah26kr54" returned: 0 in 0.361s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_ah26kr54 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:46 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_ah26kr54 Sep 28 17:18:46 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:47 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_ah26kr54" returned: 1 in 0.381s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3da6edc3-4055-4154-be43-a897ff97d7cf_ah26kr54' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:18:47 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce05ada5-71b0-4e62-8bb5-b6181c87c8a6]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_hcdphzgsdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:47 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_hcdphzgsdevstack@QuobyteHD Sep 28 17:18:47 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:47 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_hcdphzgsdevstack@QuobyteHD" returned: 0 in 0.506s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:47 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] 3da6edc3-4055-4154-be43-a897ff97d7cf was qcow2, converting to qcow2 {{(pid=87061) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:18:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_hcdphzgsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-196b417e-7d23-4af6-aa8c-2d1346c25dad {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:47 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_hcdphzgsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-196b417e-7d23-4af6-aa8c-2d1346c25dad Sep 28 17:18:47 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:50 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_hcdphzgsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-196b417e-7d23-4af6-aa8c-2d1346c25dad" returned: 0 in 3.081s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:50 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3da6edc3-4055-4154-be43-a897ff97d7cf_hcdphzgsdevstack@QuobyteHD, size 112.00 MB, duration 3.08 sec, destination /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-196b417e-7d23-4af6-aa8c-2d1346c25dad {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:18:50 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Converted 112.00 MB image at 36.32 MB/s Sep 28 17:18:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-196b417e-7d23-4af6-aa8c-2d1346c25dad 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:50 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-196b417e-7d23-4af6-aa8c-2d1346c25dad 1G Sep 28 17:18:50 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:51 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-196b417e-7d23-4af6-aa8c-2d1346c25dad 1G" returned: 0 in 0.392s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:51 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Downloaded image 3da6edc3-4055-4154-be43-a897ff97d7cf ((None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}])) to volume 196b417e-7d23-4af6-aa8c-2d1346c25dad successfully. {{(pid=87061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:18:51 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Temporary image 3da6edc3-4055-4154-be43-a897ff97d7cf for user 6b7dd0fe96c9419b9c2edc49eb23bdcc is deleted. {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:18:51 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Marking volume 196b417e-7d23-4af6-aa8c-2d1346c25dad as bootable. {{(pid=87061) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:18:51 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Copying metadata from image 3da6edc3-4055-4154-be43-a897ff97d7cf to 196b417e-7d23-4af6-aa8c-2d1346c25dad. {{(pid=87061) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:18:51 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Creating volume glance metadata for volume 196b417e-7d23-4af6-aa8c-2d1346c25dad backed by image 3da6edc3-4055-4154-be43-a897ff97d7cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87061) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:18:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb40d2f-28d9-49ef-b086-9040d17a23d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-196b417e-7d23-4af6-aa8c-2d1346c25dad', 'volume_size': 1, 'image_id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3da6edc3-4055-4154-be43-a897ff97d7cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '21d27c6a4ac749c0a5b3cbd558b3b102', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3da6edc3-4055-4154-be43-a897ff97d7cf', 'created_at': datetime.datetime(2026, 9, 28, 14, 57, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 57, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3da6edc3-4055-4154-be43-a897ff97d7cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10521dc9-4d2a-4290-964f-0f9a960e11aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:51 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Volume volume-196b417e-7d23-4af6-aa8c-2d1346c25dad (196b417e-7d23-4af6-aa8c-2d1346c25dad): created successfully Sep 28 17:18:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10521dc9-4d2a-4290-964f-0f9a960e11aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Flow 'volume_create_manager' (7148a4c4-736b-47be-ad0c-5add17cca6b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:51 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-2c479960-1723-41dd-8a58-03584a59ce76 tempest-TestShelveInstance-496333506 None] Created volume successfully. Sep 28 17:18:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-b5700350-3e76-45b0-8cd2-b6ac6ceeae27 req-6611fba8-3a46-4fad-ab6b-87fdc404017d tempest-TestShelveInstance-496333506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-b5700350-3e76-45b0-8cd2-b6ac6ceeae27 req-6611fba8-3a46-4fad-ab6b-87fdc404017d tempest-TestShelveInstance-496333506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-b5700350-3e76-45b0-8cd2-b6ac6ceeae27 req-6611fba8-3a46-4fad-ab6b-87fdc404017d tempest-TestShelveInstance-496333506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-b5700350-3e76-45b0-8cd2-b6ac6ceeae27 req-6611fba8-3a46-4fad-ab6b-87fdc404017d tempest-TestShelveInstance-496333506 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-196b417e-7d23-4af6-aa8c-2d1346c25dad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b21b9b96-7b03-4b80-88a2-9a360a983c2d', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:18:56 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-b5700350-3e76-45b0-8cd2-b6ac6ceeae27 req-6611fba8-3a46-4fad-ab6b-87fdc404017d tempest-TestShelveInstance-496333506 None] attachment_update completed successfully. Sep 28 17:19:00 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Flow 'volume_create_manager' (dbb3c09e-48b0-483e-85c1-293afc7b88ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e0e0e2-600f-4383-9b07-38c037f53f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e0e0e2-600f-4383-9b07-38c037f53f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-379573041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97cc240b-9c1c-4059-9201-3b5905252b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3934e9248fa84fb7ba6094a5346f36cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:00Z,use_quota=True,user_id='a74c5dfd1b034b25bef3aba6bd86e3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93c0cf1-2a15-4651-b42a-12f5668ade27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93c0cf1-2a15-4651-b42a-12f5668ade27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f39aa459-3052-4267-850e-acffe65485f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f39aa459-3052-4267-850e-acffe65485f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97cc240b-9c1c-4059-9201-3b5905252b10', 'volume_name': 'volume-97cc240b-9c1c-4059-9201-3b5905252b10', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f31653-2846-48c3-a78a-d74018530cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f31653-2846-48c3-a78a-d74018530cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2df2007-fc82-4818-92f8-0117da3a75d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:00 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Volume 97cc240b-9c1c-4059-9201-3b5905252b10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97cc240b-9c1c-4059-9201-3b5905252b10', 'volume_size': 1} Sep 28 17:19:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-379573041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97cc240b-9c1c-4059-9201-3b5905252b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3934e9248fa84fb7ba6094a5346f36cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:00Z,use_quota=True,user_id='a74c5dfd1b034b25bef3aba6bd86e3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Creating volume 97cc240b-9c1c-4059-9201-3b5905252b10 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:00 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:19:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-97cc240b-9c1c-4059-9201-3b5905252b10 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:00 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-97cc240b-9c1c-4059-9201-3b5905252b10 1073741824 Sep 28 17:19:00 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:01 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-97cc240b-9c1c-4059-9201-3b5905252b10 1073741824" returned: 0 in 0.582s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-97cc240b-9c1c-4059-9201-3b5905252b10 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:01 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-97cc240b-9c1c-4059-9201-3b5905252b10 Sep 28 17:19:01 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:01 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-97cc240b-9c1c-4059-9201-3b5905252b10" returned: 0 in 0.322s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2df2007-fc82-4818-92f8-0117da3a75d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97cc240b-9c1c-4059-9201-3b5905252b10', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99361db-d210-46f5-9a39-e43d057e392d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:01 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Volume volume-97cc240b-9c1c-4059-9201-3b5905252b10 (97cc240b-9c1c-4059-9201-3b5905252b10): created successfully Sep 28 17:19:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99361db-d210-46f5-9a39-e43d057e392d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Flow 'volume_create_manager' (dbb3c09e-48b0-483e-85c1-293afc7b88ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:01 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-7b2036af-7b55-4350-8037-cddd5ab3c524 tempest-AttachVolumeNegativeTest-648762481 None] Created volume successfully. Sep 28 17:19:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-a4a15b03-703f-4201-9fa5-81a928799135 req-cdef868a-ae39-417b-a398-1bb2351c56c5 tempest-AttachVolumeNegativeTest-648762481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-a4a15b03-703f-4201-9fa5-81a928799135 req-cdef868a-ae39-417b-a398-1bb2351c56c5 tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-a4a15b03-703f-4201-9fa5-81a928799135 req-cdef868a-ae39-417b-a398-1bb2351c56c5 tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-a4a15b03-703f-4201-9fa5-81a928799135 req-cdef868a-ae39-417b-a398-1bb2351c56c5 tempest-AttachVolumeNegativeTest-648762481 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-97cc240b-9c1c-4059-9201-3b5905252b10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '955dabc9-21e7-4ea6-9e85-338d101df7f2', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:19:03 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-a4a15b03-703f-4201-9fa5-81a928799135 req-cdef868a-ae39-417b-a398-1bb2351c56c5 tempest-AttachVolumeNegativeTest-648762481 None] attachment_update completed successfully. Sep 28 17:19:06 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-f8676f48-dfb9-42b8-9c69-70746d381873 req-eb59f0a3-cf28-49d6-9ec4-66362d721f18 tempest-AttachVolumeNegativeTest-648762481 None] Terminate volume connection completed successfully. Sep 28 17:19:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-f8676f48-dfb9-42b8-9c69-70746d381873 req-eb59f0a3-cf28-49d6-9ec4-66362d721f18 tempest-AttachVolumeNegativeTest-648762481 None] Deleting attachment 955dabc9-21e7-4ea6-9e85-338d101df7f2. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:19:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:19:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:06 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:19:06 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:07 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.676s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:19:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:19:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:19:12 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Flow 'volume_create_manager' (1cc50b6e-8fc6-46d5-9c59-d2f91c1ea825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e907912-7a78-4b73-b14d-c6cb7fda7c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e907912-7a78-4b73-b14d-c6cb7fda7c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1930137146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8845d570-f5ac-45d4-b8e8-54280f34d8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c30f3fe893141fba470cb32af77f137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:12Z,use_quota=True,user_id='83c350be5ebc41d2a01d81da8771294c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5595df1f-b4a4-4822-aa32-d394705b6f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5595df1f-b4a4-4822-aa32-d394705b6f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5465de80-356c-4fbe-a46c-73f275930da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5465de80-356c-4fbe-a46c-73f275930da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8845d570-f5ac-45d4-b8e8-54280f34d8d0', 'volume_name': 'volume-8845d570-f5ac-45d4-b8e8-54280f34d8d0', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (add194e7-be53-4462-9c17-6721268af4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (add194e7-be53-4462-9c17-6721268af4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7fb30d0-25cd-4090-8f22-4379171fe83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:12 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Volume 8845d570-f5ac-45d4-b8e8-54280f34d8d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8845d570-f5ac-45d4-b8e8-54280f34d8d0', 'volume_size': 1} Sep 28 17:19:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1930137146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8845d570-f5ac-45d4-b8e8-54280f34d8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c30f3fe893141fba470cb32af77f137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:12Z,use_quota=True,user_id='83c350be5ebc41d2a01d81da8771294c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Creating volume 8845d570-f5ac-45d4-b8e8-54280f34d8d0 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:12 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:19:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8845d570-f5ac-45d4-b8e8-54280f34d8d0 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:12 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8845d570-f5ac-45d4-b8e8-54280f34d8d0 1073741824 Sep 28 17:19:12 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:13 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8845d570-f5ac-45d4-b8e8-54280f34d8d0 1073741824" returned: 0 in 0.694s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8845d570-f5ac-45d4-b8e8-54280f34d8d0 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:13 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8845d570-f5ac-45d4-b8e8-54280f34d8d0 Sep 28 17:19:13 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:13 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8845d570-f5ac-45d4-b8e8-54280f34d8d0" returned: 0 in 0.251s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:13 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7fb30d0-25cd-4090-8f22-4379171fe83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8845d570-f5ac-45d4-b8e8-54280f34d8d0', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f70e1f-2a41-4c83-a90b-8a5dd5bdc7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:13 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Volume volume-8845d570-f5ac-45d4-b8e8-54280f34d8d0 (8845d570-f5ac-45d4-b8e8-54280f34d8d0): created successfully Sep 28 17:19:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f70e1f-2a41-4c83-a90b-8a5dd5bdc7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Flow 'volume_create_manager' (1cc50b6e-8fc6-46d5-9c59-d2f91c1ea825) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:13 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-910165eb-fd16-45a3-aef2-3bb33a6e7ea3 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Created volume successfully. Sep 28 17:19:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-303d0d5a-a0e8-4f0c-a506-a2dfbd63f6f3 tempest-AttachVolumeNegativeTest-648762481 None] Acquiring lock "cinder-97cc240b-9c1c-4059-9201-3b5905252b10-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-303d0d5a-a0e8-4f0c-a506-a2dfbd63f6f3 tempest-AttachVolumeNegativeTest-648762481 None] Lock "cinder-97cc240b-9c1c-4059-9201-3b5905252b10-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-303d0d5a-a0e8-4f0c-a506-a2dfbd63f6f3 tempest-AttachVolumeNegativeTest-648762481 None] Acquiring lock "cinder-quobyte-97cc240b-9c1c-4059-9201-3b5905252b10" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-303d0d5a-a0e8-4f0c-a506-a2dfbd63f6f3 tempest-AttachVolumeNegativeTest-648762481 None] Lock "cinder-quobyte-97cc240b-9c1c-4059-9201-3b5905252b10" acquired by "delete_volume" :: waited 0.040s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:14 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee14ae0c-4cd3-4d45-bcc4-a8b920295d11]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-303d0d5a-a0e8-4f0c-a506-a2dfbd63f6f3 tempest-AttachVolumeNegativeTest-648762481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-97cc240b-9c1c-4059-9201-3b5905252b10 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:15 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-97cc240b-9c1c-4059-9201-3b5905252b10 Sep 28 17:19:15 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:15 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-303d0d5a-a0e8-4f0c-a506-a2dfbd63f6f3 tempest-AttachVolumeNegativeTest-648762481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-97cc240b-9c1c-4059-9201-3b5905252b10" returned: 0 in 0.540s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-303d0d5a-a0e8-4f0c-a506-a2dfbd63f6f3 tempest-AttachVolumeNegativeTest-648762481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-97cc240b-9c1c-4059-9201-3b5905252b10 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:15 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-97cc240b-9c1c-4059-9201-3b5905252b10 Sep 28 17:19:15 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-5bc149f4-64fb-40dc-86fa-d757d6a3928a req-9373b560-0343-4f49-a1e5-c408d286107d tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-5bc149f4-64fb-40dc-86fa-d757d6a3928a req-9373b560-0343-4f49-a1e5-c408d286107d tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-5bc149f4-64fb-40dc-86fa-d757d6a3928a req-9373b560-0343-4f49-a1e5-c408d286107d tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-5bc149f4-64fb-40dc-86fa-d757d6a3928a req-9373b560-0343-4f49-a1e5-c408d286107d tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-8845d570-f5ac-45d4-b8e8-54280f34d8d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf7591b2-fce5-4ff9-89b4-5458c29fc3fe', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:19:15 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-5bc149f4-64fb-40dc-86fa-d757d6a3928a req-9373b560-0343-4f49-a1e5-c408d286107d tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] attachment_update completed successfully. Sep 28 17:19:15 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-303d0d5a-a0e8-4f0c-a506-a2dfbd63f6f3 tempest-AttachVolumeNegativeTest-648762481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-97cc240b-9c1c-4059-9201-3b5905252b10" returned: 0 in 0.335s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-303d0d5a-a0e8-4f0c-a506-a2dfbd63f6f3 tempest-AttachVolumeNegativeTest-648762481 None] Lock "cinder-quobyte-97cc240b-9c1c-4059-9201-3b5905252b10" released by "delete_volume" :: held 0.969s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:15 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-303d0d5a-a0e8-4f0c-a506-a2dfbd63f6f3 tempest-AttachVolumeNegativeTest-648762481 None] Created reservations ['37fc96d1-a2ae-4d09-8d4c-5af05af964c7', 'aae06342-feae-4aa0-a3db-a9966a4ced99', 'd887f972-c00d-43d1-acc9-d18a7cd3c155', '31ff1aa0-89db-4433-a908-21b625e0b3b6'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-303d0d5a-a0e8-4f0c-a506-a2dfbd63f6f3 tempest-AttachVolumeNegativeTest-648762481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-303d0d5a-a0e8-4f0c-a506-a2dfbd63f6f3 tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:15 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-303d0d5a-a0e8-4f0c-a506-a2dfbd63f6f3 tempest-AttachVolumeNegativeTest-648762481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:15 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-303d0d5a-a0e8-4f0c-a506-a2dfbd63f6f3 tempest-AttachVolumeNegativeTest-648762481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-303d0d5a-a0e8-4f0c-a506-a2dfbd63f6f3 tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-303d0d5a-a0e8-4f0c-a506-a2dfbd63f6f3 tempest-AttachVolumeNegativeTest-648762481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:16 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:19:16 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:16 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-303d0d5a-a0e8-4f0c-a506-a2dfbd63f6f3 tempest-AttachVolumeNegativeTest-648762481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.410s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:16 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-303d0d5a-a0e8-4f0c-a506-a2dfbd63f6f3 tempest-AttachVolumeNegativeTest-648762481 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:16 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-303d0d5a-a0e8-4f0c-a506-a2dfbd63f6f3 tempest-AttachVolumeNegativeTest-648762481 None] Deleted volume successfully. Sep 28 17:19:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-303d0d5a-a0e8-4f0c-a506-a2dfbd63f6f3 tempest-AttachVolumeNegativeTest-648762481 None] Lock "cinder-97cc240b-9c1c-4059-9201-3b5905252b10-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-46084d74-fc95-4504-9dfd-543f7109b113 tempest-AttachVolumeNegativeTest-648762481 None] Acquiring lock "cinder-b2ed6588-453d-4355-90c9-1e8a15f0f5f1-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-46084d74-fc95-4504-9dfd-543f7109b113 tempest-AttachVolumeNegativeTest-648762481 None] Lock "cinder-b2ed6588-453d-4355-90c9-1e8a15f0f5f1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-46084d74-fc95-4504-9dfd-543f7109b113 tempest-AttachVolumeNegativeTest-648762481 None] Acquiring lock "cinder-quobyte-b2ed6588-453d-4355-90c9-1e8a15f0f5f1" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-46084d74-fc95-4504-9dfd-543f7109b113 tempest-AttachVolumeNegativeTest-648762481 None] Lock "cinder-quobyte-b2ed6588-453d-4355-90c9-1e8a15f0f5f1" acquired by "delete_volume" :: waited 0.019s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:17 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[db774ff3-f730-446c-be01-847d3802ad3c]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-46084d74-fc95-4504-9dfd-543f7109b113 tempest-AttachVolumeNegativeTest-648762481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b2ed6588-453d-4355-90c9-1e8a15f0f5f1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:17 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b2ed6588-453d-4355-90c9-1e8a15f0f5f1 Sep 28 17:19:17 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:17 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-46084d74-fc95-4504-9dfd-543f7109b113 tempest-AttachVolumeNegativeTest-648762481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b2ed6588-453d-4355-90c9-1e8a15f0f5f1" returned: 0 in 0.464s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-46084d74-fc95-4504-9dfd-543f7109b113 tempest-AttachVolumeNegativeTest-648762481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b2ed6588-453d-4355-90c9-1e8a15f0f5f1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:17 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b2ed6588-453d-4355-90c9-1e8a15f0f5f1 Sep 28 17:19:17 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:17 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-46084d74-fc95-4504-9dfd-543f7109b113 tempest-AttachVolumeNegativeTest-648762481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-b2ed6588-453d-4355-90c9-1e8a15f0f5f1" returned: 0 in 0.281s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-46084d74-fc95-4504-9dfd-543f7109b113 tempest-AttachVolumeNegativeTest-648762481 None] Lock "cinder-quobyte-b2ed6588-453d-4355-90c9-1e8a15f0f5f1" released by "delete_volume" :: held 0.814s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:18 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-46084d74-fc95-4504-9dfd-543f7109b113 tempest-AttachVolumeNegativeTest-648762481 None] Created reservations ['505d4c75-17e7-404e-ac59-76b0db641ab0', '258d5a4f-9179-4139-9deb-98e6e68841cf', '05fe14f3-b2f3-4b8f-b6b6-4d0cd476dcbd', 'e4858958-daa0-462f-b2f3-274846a5c5de'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-46084d74-fc95-4504-9dfd-543f7109b113 tempest-AttachVolumeNegativeTest-648762481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-46084d74-fc95-4504-9dfd-543f7109b113 tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:18 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-46084d74-fc95-4504-9dfd-543f7109b113 tempest-AttachVolumeNegativeTest-648762481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:18 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-46084d74-fc95-4504-9dfd-543f7109b113 tempest-AttachVolumeNegativeTest-648762481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-46084d74-fc95-4504-9dfd-543f7109b113 tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-46084d74-fc95-4504-9dfd-543f7109b113 tempest-AttachVolumeNegativeTest-648762481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:18 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:19:18 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:18 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-46084d74-fc95-4504-9dfd-543f7109b113 tempest-AttachVolumeNegativeTest-648762481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.417s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:18 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-46084d74-fc95-4504-9dfd-543f7109b113 tempest-AttachVolumeNegativeTest-648762481 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:18 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-46084d74-fc95-4504-9dfd-543f7109b113 tempest-AttachVolumeNegativeTest-648762481 None] Deleted volume successfully. Sep 28 17:19:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-46084d74-fc95-4504-9dfd-543f7109b113 tempest-AttachVolumeNegativeTest-648762481 None] Lock "cinder-b2ed6588-453d-4355-90c9-1e8a15f0f5f1-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8730209e-bb11-4bb8-8de4-151ec04c97a4 tempest-AttachVolumeNegativeTest-648762481 None] Acquiring lock "cinder-e237d92a-013f-4c5e-ba60-ee243b45ba6b-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8730209e-bb11-4bb8-8de4-151ec04c97a4 tempest-AttachVolumeNegativeTest-648762481 None] Lock "cinder-e237d92a-013f-4c5e-ba60-ee243b45ba6b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8730209e-bb11-4bb8-8de4-151ec04c97a4 tempest-AttachVolumeNegativeTest-648762481 None] Acquiring lock "cinder-quobyte-e237d92a-013f-4c5e-ba60-ee243b45ba6b" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8730209e-bb11-4bb8-8de4-151ec04c97a4 tempest-AttachVolumeNegativeTest-648762481 None] Lock "cinder-quobyte-e237d92a-013f-4c5e-ba60-ee243b45ba6b" acquired by "delete_volume" :: waited 0.021s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:18 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b4f448-f36f-40c2-9f77-967cb0ff959a]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8730209e-bb11-4bb8-8de4-151ec04c97a4 tempest-AttachVolumeNegativeTest-648762481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e237d92a-013f-4c5e-ba60-ee243b45ba6b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:19 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e237d92a-013f-4c5e-ba60-ee243b45ba6b Sep 28 17:19:19 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:19 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8730209e-bb11-4bb8-8de4-151ec04c97a4 tempest-AttachVolumeNegativeTest-648762481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e237d92a-013f-4c5e-ba60-ee243b45ba6b" returned: 0 in 0.521s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8730209e-bb11-4bb8-8de4-151ec04c97a4 tempest-AttachVolumeNegativeTest-648762481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e237d92a-013f-4c5e-ba60-ee243b45ba6b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:19 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e237d92a-013f-4c5e-ba60-ee243b45ba6b Sep 28 17:19:19 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:19 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8730209e-bb11-4bb8-8de4-151ec04c97a4 tempest-AttachVolumeNegativeTest-648762481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e237d92a-013f-4c5e-ba60-ee243b45ba6b" returned: 0 in 0.314s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:19 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-2700f822-9179-49bf-9b85-e708cc71df84 req-7785daa1-76db-4974-907f-9ad7ff56cff8 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Terminate volume connection completed successfully. Sep 28 17:19:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-2700f822-9179-49bf-9b85-e708cc71df84 req-7785daa1-76db-4974-907f-9ad7ff56cff8 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Deleting attachment bf7591b2-fce5-4ff9-89b4-5458c29fc3fe. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:19:19 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8730209e-bb11-4bb8-8de4-151ec04c97a4 tempest-AttachVolumeNegativeTest-648762481 None] Lock "cinder-quobyte-e237d92a-013f-4c5e-ba60-ee243b45ba6b" released by "delete_volume" :: held 0.895s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:19 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-8730209e-bb11-4bb8-8de4-151ec04c97a4 tempest-AttachVolumeNegativeTest-648762481 None] Created reservations ['c95b9483-f196-489e-8728-80df6bee4ef6', '464d417f-440c-4a78-8478-07fe09b15059', '2895168c-5f63-441a-b0ac-8763ddfe7c09', '801eb925-742d-4c83-826e-eccbffe22b18'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8730209e-bb11-4bb8-8de4-151ec04c97a4 tempest-AttachVolumeNegativeTest-648762481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8730209e-bb11-4bb8-8de4-151ec04c97a4 tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8730209e-bb11-4bb8-8de4-151ec04c97a4 tempest-AttachVolumeNegativeTest-648762481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8730209e-bb11-4bb8-8de4-151ec04c97a4 tempest-AttachVolumeNegativeTest-648762481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8730209e-bb11-4bb8-8de4-151ec04c97a4 tempest-AttachVolumeNegativeTest-648762481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8730209e-bb11-4bb8-8de4-151ec04c97a4 tempest-AttachVolumeNegativeTest-648762481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:19 devstack sudo[102071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:19:19 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:20 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8730209e-bb11-4bb8-8de4-151ec04c97a4 tempest-AttachVolumeNegativeTest-648762481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.305s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:20 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-8730209e-bb11-4bb8-8de4-151ec04c97a4 tempest-AttachVolumeNegativeTest-648762481 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:20 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-8730209e-bb11-4bb8-8de4-151ec04c97a4 tempest-AttachVolumeNegativeTest-648762481 None] Deleted volume successfully. Sep 28 17:19:20 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8730209e-bb11-4bb8-8de4-151ec04c97a4 tempest-AttachVolumeNegativeTest-648762481 None] Lock "cinder-e237d92a-013f-4c5e-ba60-ee243b45ba6b-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:20 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ccef8f1b-bfe8-4473-a948-f8005f41c941 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Acquiring lock "cinder-8845d570-f5ac-45d4-b8e8-54280f34d8d0-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:20 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ccef8f1b-bfe8-4473-a948-f8005f41c941 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Lock "cinder-8845d570-f5ac-45d4-b8e8-54280f34d8d0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:20 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ccef8f1b-bfe8-4473-a948-f8005f41c941 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Acquiring lock "cinder-quobyte-8845d570-f5ac-45d4-b8e8-54280f34d8d0" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:20 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ccef8f1b-bfe8-4473-a948-f8005f41c941 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Lock "cinder-quobyte-8845d570-f5ac-45d4-b8e8-54280f34d8d0" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:20 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74c80a1-ad69-4fba-959d-d36db76498e5]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ccef8f1b-bfe8-4473-a948-f8005f41c941 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8845d570-f5ac-45d4-b8e8-54280f34d8d0 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:20 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8845d570-f5ac-45d4-b8e8-54280f34d8d0 Sep 28 17:19:20 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:21 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ccef8f1b-bfe8-4473-a948-f8005f41c941 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8845d570-f5ac-45d4-b8e8-54280f34d8d0" returned: 0 in 0.498s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ccef8f1b-bfe8-4473-a948-f8005f41c941 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8845d570-f5ac-45d4-b8e8-54280f34d8d0 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:21 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8845d570-f5ac-45d4-b8e8-54280f34d8d0 Sep 28 17:19:21 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:21 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ccef8f1b-bfe8-4473-a948-f8005f41c941 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8845d570-f5ac-45d4-b8e8-54280f34d8d0" returned: 0 in 0.355s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ccef8f1b-bfe8-4473-a948-f8005f41c941 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Lock "cinder-quobyte-8845d570-f5ac-45d4-b8e8-54280f34d8d0" released by "delete_volume" :: held 0.916s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:21 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-ccef8f1b-bfe8-4473-a948-f8005f41c941 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Created reservations ['e829d1c7-4439-45d6-a501-3dc1429f8483', 'be5cd636-fda6-4eae-abb4-99345b0e47ee', '94c308cc-3cce-4417-b0f4-a9d6216d687b', 'fc1e4d64-25d5-40a0-a55b-d631953be011'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ccef8f1b-bfe8-4473-a948-f8005f41c941 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ccef8f1b-bfe8-4473-a948-f8005f41c941 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:21 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ccef8f1b-bfe8-4473-a948-f8005f41c941 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:21 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ccef8f1b-bfe8-4473-a948-f8005f41c941 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ccef8f1b-bfe8-4473-a948-f8005f41c941 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ccef8f1b-bfe8-4473-a948-f8005f41c941 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:21 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:19:21 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:22 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ccef8f1b-bfe8-4473-a948-f8005f41c941 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.358s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:22 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-ccef8f1b-bfe8-4473-a948-f8005f41c941 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:22 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-ccef8f1b-bfe8-4473-a948-f8005f41c941 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Deleted volume successfully. Sep 28 17:19:22 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ccef8f1b-bfe8-4473-a948-f8005f41c941 tempest-TestServerVolumeAttachScenarioOldVersion-1201063655 None] Lock "cinder-8845d570-f5ac-45d4-b8e8-54280f34d8d0-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:31 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=59,cinder:UPDATE=44,cinder:INSERT=15,cinder:DELETE=3 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:19:31 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:31 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Flow 'volume_create_manager' (bd4bdce0-c6fe-4249-afb0-60c196ca19e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:31 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c1c098-6f78-43b4-9b21-4db4fbb2ec86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:31 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c1c098-6f78-43b4-9b21-4db4fbb2ec86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-191629255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25708a72-263a-46ee-8258-752ff157d336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='453820493fdb47abb9b64d724a2fd69b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:32Z,use_quota=True,user_id='258267eead8642e89213d4466c27414e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0816b699-6234-419a-8a2d-ceae43caace3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0816b699-6234-419a-8a2d-ceae43caace3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38521f6c-c891-4b3c-b198-c6986bfaab13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38521f6c-c891-4b3c-b198-c6986bfaab13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25708a72-263a-46ee-8258-752ff157d336', 'volume_name': 'volume-25708a72-263a-46ee-8258-752ff157d336', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82f6807-2a4e-41cf-a832-b088b488b95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82f6807-2a4e-41cf-a832-b088b488b95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33b2ff3-c492-47b0-abef-1b9fb6533e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:32 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Volume 25708a72-263a-46ee-8258-752ff157d336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25708a72-263a-46ee-8258-752ff157d336', 'volume_size': 1} Sep 28 17:19:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-191629255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25708a72-263a-46ee-8258-752ff157d336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='453820493fdb47abb9b64d724a2fd69b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:32Z,use_quota=True,user_id='258267eead8642e89213d4466c27414e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Creating volume 25708a72-263a-46ee-8258-752ff157d336 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:32 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:19:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:32 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336 1073741824 Sep 28 17:19:32 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:32 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336 1073741824" returned: 0 in 0.651s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:32 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336 Sep 28 17:19:32 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:33 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336" returned: 0 in 0.394s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:33 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33b2ff3-c492-47b0-abef-1b9fb6533e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25708a72-263a-46ee-8258-752ff157d336', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3459fa2b-0e38-424c-82ce-a67341f3b9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:33 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Volume volume-25708a72-263a-46ee-8258-752ff157d336 (25708a72-263a-46ee-8258-752ff157d336): created successfully Sep 28 17:19:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3459fa2b-0e38-424c-82ce-a67341f3b9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Flow 'volume_create_manager' (bd4bdce0-c6fe-4249-afb0-60c196ca19e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:33 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-af56f9d1-3acd-40b2-95e6-da7966dd2af9 req-010c40d8-5e62-4793-a3f4-197437951ca6 tempest-VolumesSnapshotsTestJSON-1912821165 None] Created volume successfully. Sep 28 17:19:34 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:UPDATE=55,cinder:SELECT=54,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:19:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-8cb851cc-a192-4657-86ce-63c9543705ec req-2eb7fe78-ae37-4f55-a4b6-eb5b032bc863 tempest-VolumesSnapshotsTestJSON-1912821165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-8cb851cc-a192-4657-86ce-63c9543705ec req-2eb7fe78-ae37-4f55-a4b6-eb5b032bc863 tempest-VolumesSnapshotsTestJSON-1912821165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [req-8cb851cc-a192-4657-86ce-63c9543705ec req-2eb7fe78-ae37-4f55-a4b6-eb5b032bc863 tempest-VolumesSnapshotsTestJSON-1912821165 None] Creating offline snapshot a408b5b6-fb5d-4297-8574-0b01bb2761a6 of volume 25708a72-263a-46ee-8258-752ff157d336 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:19:34 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d14b5b-2463-4e64-aa96-bba1e7d8d87d]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-8cb851cc-a192-4657-86ce-63c9543705ec req-2eb7fe78-ae37-4f55-a4b6-eb5b032bc863 tempest-VolumesSnapshotsTestJSON-1912821165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:35 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336 Sep 28 17:19:35 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:35 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-8cb851cc-a192-4657-86ce-63c9543705ec req-2eb7fe78-ae37-4f55-a4b6-eb5b032bc863 tempest-VolumesSnapshotsTestJSON-1912821165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336" returned: 0 in 0.497s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-8cb851cc-a192-4657-86ce-63c9543705ec req-2eb7fe78-ae37-4f55-a4b6-eb5b032bc863 tempest-VolumesSnapshotsTestJSON-1912821165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.a408b5b6-fb5d-4297-8574-0b01bb2761a6 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:35 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.a408b5b6-fb5d-4297-8574-0b01bb2761a6 1G Sep 28 17:19:35 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:35 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-8cb851cc-a192-4657-86ce-63c9543705ec req-2eb7fe78-ae37-4f55-a4b6-eb5b032bc863 tempest-VolumesSnapshotsTestJSON-1912821165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.a408b5b6-fb5d-4297-8574-0b01bb2761a6 1G" returned: 0 in 0.541s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-8cb851cc-a192-4657-86ce-63c9543705ec req-2eb7fe78-ae37-4f55-a4b6-eb5b032bc863 tempest-VolumesSnapshotsTestJSON-1912821165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25708a72-263a-46ee-8258-752ff157d336 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.a408b5b6-fb5d-4297-8574-0b01bb2761a6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:35 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25708a72-263a-46ee-8258-752ff157d336 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.a408b5b6-fb5d-4297-8574-0b01bb2761a6 Sep 28 17:19:35 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:36 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-8cb851cc-a192-4657-86ce-63c9543705ec req-2eb7fe78-ae37-4f55-a4b6-eb5b032bc863 tempest-VolumesSnapshotsTestJSON-1912821165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25708a72-263a-46ee-8258-752ff157d336 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.a408b5b6-fb5d-4297-8574-0b01bb2761a6" returned: 0 in 0.426s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:36 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [req-8cb851cc-a192-4657-86ce-63c9543705ec req-2eb7fe78-ae37-4f55-a4b6-eb5b032bc863 tempest-VolumesSnapshotsTestJSON-1912821165 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.a408b5b6-fb5d-4297-8574-0b01bb2761a6 is being set with open permissions: ugo+rw Sep 28 17:19:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-8cb851cc-a192-4657-86ce-63c9543705ec req-2eb7fe78-ae37-4f55-a4b6-eb5b032bc863 tempest-VolumesSnapshotsTestJSON-1912821165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.a408b5b6-fb5d-4297-8574-0b01bb2761a6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:36 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.a408b5b6-fb5d-4297-8574-0b01bb2761a6 Sep 28 17:19:36 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:36 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-8cb851cc-a192-4657-86ce-63c9543705ec req-2eb7fe78-ae37-4f55-a4b6-eb5b032bc863 tempest-VolumesSnapshotsTestJSON-1912821165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.a408b5b6-fb5d-4297-8574-0b01bb2761a6" returned: 0 in 0.306s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-8cb851cc-a192-4657-86ce-63c9543705ec req-2eb7fe78-ae37-4f55-a4b6-eb5b032bc863 tempest-VolumesSnapshotsTestJSON-1912821165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:36 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.info Sep 28 17:19:36 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:36 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-8cb851cc-a192-4657-86ce-63c9543705ec req-2eb7fe78-ae37-4f55-a4b6-eb5b032bc863 tempest-VolumesSnapshotsTestJSON-1912821165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.info" returned: 0 in 0.317s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:36 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [req-8cb851cc-a192-4657-86ce-63c9543705ec req-2eb7fe78-ae37-4f55-a4b6-eb5b032bc863 tempest-VolumesSnapshotsTestJSON-1912821165 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.info is being set with open permissions: ugo+rw Sep 28 17:19:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-8cb851cc-a192-4657-86ce-63c9543705ec req-2eb7fe78-ae37-4f55-a4b6-eb5b032bc863 tempest-VolumesSnapshotsTestJSON-1912821165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:37 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.info Sep 28 17:19:37 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:37 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-8cb851cc-a192-4657-86ce-63c9543705ec req-2eb7fe78-ae37-4f55-a4b6-eb5b032bc863 tempest-VolumesSnapshotsTestJSON-1912821165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.info" returned: 0 in 0.322s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-8cb851cc-a192-4657-86ce-63c9543705ec req-2eb7fe78-ae37-4f55-a4b6-eb5b032bc863 tempest-VolumesSnapshotsTestJSON-1912821165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.545s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:37 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-8cb851cc-a192-4657-86ce-63c9543705ec req-2eb7fe78-ae37-4f55-a4b6-eb5b032bc863 tempest-VolumesSnapshotsTestJSON-1912821165 None] Create snapshot completed successfully Sep 28 17:19:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-c490d3d0-7030-4b7e-9fb9-5d8b5a6f1141 req-a1fb8d39-2244-42b6-8ee0-4a6318297f31 tempest-VolumesSnapshotsTestJSON-1912821165 None] Acquiring lock "cinder-a408b5b6-fb5d-4297-8574-0b01bb2761a6-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-c490d3d0-7030-4b7e-9fb9-5d8b5a6f1141 req-a1fb8d39-2244-42b6-8ee0-4a6318297f31 tempest-VolumesSnapshotsTestJSON-1912821165 None] Lock "cinder-a408b5b6-fb5d-4297-8574-0b01bb2761a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-c490d3d0-7030-4b7e-9fb9-5d8b5a6f1141 req-a1fb8d39-2244-42b6-8ee0-4a6318297f31 tempest-VolumesSnapshotsTestJSON-1912821165 None] Acquiring lock "cinder-quobyte-25708a72-263a-46ee-8258-752ff157d336" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-c490d3d0-7030-4b7e-9fb9-5d8b5a6f1141 req-a1fb8d39-2244-42b6-8ee0-4a6318297f31 tempest-VolumesSnapshotsTestJSON-1912821165 None] Lock "cinder-quobyte-25708a72-263a-46ee-8258-752ff157d336" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-c490d3d0-7030-4b7e-9fb9-5d8b5a6f1141 req-a1fb8d39-2244-42b6-8ee0-4a6318297f31 tempest-VolumesSnapshotsTestJSON-1912821165 None] Acquiring lock "cinder-quobyte-a408b5b6-fb5d-4297-8574-0b01bb2761a6" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-c490d3d0-7030-4b7e-9fb9-5d8b5a6f1141 req-a1fb8d39-2244-42b6-8ee0-4a6318297f31 tempest-VolumesSnapshotsTestJSON-1912821165 None] Lock "cinder-quobyte-a408b5b6-fb5d-4297-8574-0b01bb2761a6" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [req-c490d3d0-7030-4b7e-9fb9-5d8b5a6f1141 req-a1fb8d39-2244-42b6-8ee0-4a6318297f31 tempest-VolumesSnapshotsTestJSON-1912821165 None] Deleting offline snapshot a408b5b6-fb5d-4297-8574-0b01bb2761a6 of volume 25708a72-263a-46ee-8258-752ff157d336 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:19:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [req-c490d3d0-7030-4b7e-9fb9-5d8b5a6f1141 req-a1fb8d39-2244-42b6-8ee0-4a6318297f31 tempest-VolumesSnapshotsTestJSON-1912821165 None] snapshot_file for this snap is: volume-25708a72-263a-46ee-8258-752ff157d336.a408b5b6-fb5d-4297-8574-0b01bb2761a6 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:19:38 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[add62819-ef11-4c70-baa0-b566e74fd0e8]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-c490d3d0-7030-4b7e-9fb9-5d8b5a6f1141 req-a1fb8d39-2244-42b6-8ee0-4a6318297f31 tempest-VolumesSnapshotsTestJSON-1912821165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.a408b5b6-fb5d-4297-8574-0b01bb2761a6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:38 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.a408b5b6-fb5d-4297-8574-0b01bb2761a6 Sep 28 17:19:38 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:39 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-c490d3d0-7030-4b7e-9fb9-5d8b5a6f1141 req-a1fb8d39-2244-42b6-8ee0-4a6318297f31 tempest-VolumesSnapshotsTestJSON-1912821165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.a408b5b6-fb5d-4297-8574-0b01bb2761a6" returned: 0 in 0.496s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [req-c490d3d0-7030-4b7e-9fb9-5d8b5a6f1141 req-a1fb8d39-2244-42b6-8ee0-4a6318297f31 tempest-VolumesSnapshotsTestJSON-1912821165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25708a72-263a-46ee-8258-752ff157d336(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:19:39 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc2a429-9418-4db8-a7a7-d83ff3abb8cd]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-c490d3d0-7030-4b7e-9fb9-5d8b5a6f1141 req-a1fb8d39-2244-42b6-8ee0-4a6318297f31 tempest-VolumesSnapshotsTestJSON-1912821165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:39 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336 Sep 28 17:19:39 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:39 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-c490d3d0-7030-4b7e-9fb9-5d8b5a6f1141 req-a1fb8d39-2244-42b6-8ee0-4a6318297f31 tempest-VolumesSnapshotsTestJSON-1912821165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336" returned: 0 in 0.547s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-c490d3d0-7030-4b7e-9fb9-5d8b5a6f1141 req-a1fb8d39-2244-42b6-8ee0-4a6318297f31 tempest-VolumesSnapshotsTestJSON-1912821165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.a408b5b6-fb5d-4297-8574-0b01bb2761a6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:39 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.a408b5b6-fb5d-4297-8574-0b01bb2761a6 Sep 28 17:19:39 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:40 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-c490d3d0-7030-4b7e-9fb9-5d8b5a6f1141 req-a1fb8d39-2244-42b6-8ee0-4a6318297f31 tempest-VolumesSnapshotsTestJSON-1912821165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.a408b5b6-fb5d-4297-8574-0b01bb2761a6" returned: 0 in 0.480s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-c490d3d0-7030-4b7e-9fb9-5d8b5a6f1141 req-a1fb8d39-2244-42b6-8ee0-4a6318297f31 tempest-VolumesSnapshotsTestJSON-1912821165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.a408b5b6-fb5d-4297-8574-0b01bb2761a6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:40 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.a408b5b6-fb5d-4297-8574-0b01bb2761a6 Sep 28 17:19:40 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:40 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-c490d3d0-7030-4b7e-9fb9-5d8b5a6f1141 req-a1fb8d39-2244-42b6-8ee0-4a6318297f31 tempest-VolumesSnapshotsTestJSON-1912821165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336.a408b5b6-fb5d-4297-8574-0b01bb2761a6" returned: 0 in 0.334s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-c490d3d0-7030-4b7e-9fb9-5d8b5a6f1141 req-a1fb8d39-2244-42b6-8ee0-4a6318297f31 tempest-VolumesSnapshotsTestJSON-1912821165 None] Lock "cinder-quobyte-a408b5b6-fb5d-4297-8574-0b01bb2761a6" released by "_delete_snapshot" :: held 2.006s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-c490d3d0-7030-4b7e-9fb9-5d8b5a6f1141 req-a1fb8d39-2244-42b6-8ee0-4a6318297f31 tempest-VolumesSnapshotsTestJSON-1912821165 None] Lock "cinder-quobyte-25708a72-263a-46ee-8258-752ff157d336" released by "delete_snapshot" :: held 2.043s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:40 devstack cinder-volume[87061]: DEBUG cinder.quota [req-c490d3d0-7030-4b7e-9fb9-5d8b5a6f1141 req-a1fb8d39-2244-42b6-8ee0-4a6318297f31 tempest-VolumesSnapshotsTestJSON-1912821165 None] Created reservations ['17b8afad-1a93-4f2b-bed1-ec2cc221f67c', '955c4569-541f-44b3-bb0c-c57e3a249085', '63c55bd1-77bc-4ce1-b5f3-09b32656a372', 'ee13c746-4437-4a0e-b9cd-17cbe800ec85'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:40 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-c490d3d0-7030-4b7e-9fb9-5d8b5a6f1141 req-a1fb8d39-2244-42b6-8ee0-4a6318297f31 tempest-VolumesSnapshotsTestJSON-1912821165 None] Delete snapshot completed successfully. Sep 28 17:19:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-c490d3d0-7030-4b7e-9fb9-5d8b5a6f1141 req-a1fb8d39-2244-42b6-8ee0-4a6318297f31 tempest-VolumesSnapshotsTestJSON-1912821165 None] Lock "cinder-a408b5b6-fb5d-4297-8574-0b01bb2761a6-delete_snapshot" released by "delete_snapshot" :: held 2.257s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-8dbffd52-700a-45c5-8b3e-f14df211308d req-6f49c5ae-6745-4ba0-90d7-194d0cb9c5cf tempest-VolumesSnapshotsTestJSON-1912821165 None] Acquiring lock "cinder-25708a72-263a-46ee-8258-752ff157d336-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-8dbffd52-700a-45c5-8b3e-f14df211308d req-6f49c5ae-6745-4ba0-90d7-194d0cb9c5cf tempest-VolumesSnapshotsTestJSON-1912821165 None] Lock "cinder-25708a72-263a-46ee-8258-752ff157d336-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-8dbffd52-700a-45c5-8b3e-f14df211308d req-6f49c5ae-6745-4ba0-90d7-194d0cb9c5cf tempest-VolumesSnapshotsTestJSON-1912821165 None] Acquiring lock "cinder-quobyte-25708a72-263a-46ee-8258-752ff157d336" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-8dbffd52-700a-45c5-8b3e-f14df211308d req-6f49c5ae-6745-4ba0-90d7-194d0cb9c5cf tempest-VolumesSnapshotsTestJSON-1912821165 None] Lock "cinder-quobyte-25708a72-263a-46ee-8258-752ff157d336" acquired by "delete_volume" :: waited 0.024s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:41 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a6dae0-ea27-4d0f-a3eb-6a8649f6408c]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-8dbffd52-700a-45c5-8b3e-f14df211308d req-6f49c5ae-6745-4ba0-90d7-194d0cb9c5cf tempest-VolumesSnapshotsTestJSON-1912821165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:42 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336 Sep 28 17:19:42 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:42 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-8dbffd52-700a-45c5-8b3e-f14df211308d req-6f49c5ae-6745-4ba0-90d7-194d0cb9c5cf tempest-VolumesSnapshotsTestJSON-1912821165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336" returned: 0 in 0.467s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-8dbffd52-700a-45c5-8b3e-f14df211308d req-6f49c5ae-6745-4ba0-90d7-194d0cb9c5cf tempest-VolumesSnapshotsTestJSON-1912821165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:42 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336 Sep 28 17:19:42 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:42 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-8dbffd52-700a-45c5-8b3e-f14df211308d req-6f49c5ae-6745-4ba0-90d7-194d0cb9c5cf tempest-VolumesSnapshotsTestJSON-1912821165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-25708a72-263a-46ee-8258-752ff157d336" returned: 0 in 0.335s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-8dbffd52-700a-45c5-8b3e-f14df211308d req-6f49c5ae-6745-4ba0-90d7-194d0cb9c5cf tempest-VolumesSnapshotsTestJSON-1912821165 None] Lock "cinder-quobyte-25708a72-263a-46ee-8258-752ff157d336" released by "delete_volume" :: held 0.904s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:42 devstack cinder-volume[87061]: DEBUG cinder.quota [req-8dbffd52-700a-45c5-8b3e-f14df211308d req-6f49c5ae-6745-4ba0-90d7-194d0cb9c5cf tempest-VolumesSnapshotsTestJSON-1912821165 None] Created reservations ['08e4f065-5bc8-41b2-bef6-0824ff3a3cb5', '2e63ab83-0d10-4603-be16-58307a5d5050', '7851fdd0-9593-44d3-9ee9-d53e9156e2e8', 'fe61d394-24dd-4c4f-a14b-3fad09627902'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-8dbffd52-700a-45c5-8b3e-f14df211308d req-6f49c5ae-6745-4ba0-90d7-194d0cb9c5cf tempest-VolumesSnapshotsTestJSON-1912821165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-8dbffd52-700a-45c5-8b3e-f14df211308d req-6f49c5ae-6745-4ba0-90d7-194d0cb9c5cf tempest-VolumesSnapshotsTestJSON-1912821165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [req-8dbffd52-700a-45c5-8b3e-f14df211308d req-6f49c5ae-6745-4ba0-90d7-194d0cb9c5cf tempest-VolumesSnapshotsTestJSON-1912821165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [req-8dbffd52-700a-45c5-8b3e-f14df211308d req-6f49c5ae-6745-4ba0-90d7-194d0cb9c5cf tempest-VolumesSnapshotsTestJSON-1912821165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-8dbffd52-700a-45c5-8b3e-f14df211308d req-6f49c5ae-6745-4ba0-90d7-194d0cb9c5cf tempest-VolumesSnapshotsTestJSON-1912821165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-8dbffd52-700a-45c5-8b3e-f14df211308d req-6f49c5ae-6745-4ba0-90d7-194d0cb9c5cf tempest-VolumesSnapshotsTestJSON-1912821165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:42 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:19:42 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:43 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-8dbffd52-700a-45c5-8b3e-f14df211308d req-6f49c5ae-6745-4ba0-90d7-194d0cb9c5cf tempest-VolumesSnapshotsTestJSON-1912821165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.373s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:43 devstack cinder-volume[87061]: DEBUG cinder.manager [req-8dbffd52-700a-45c5-8b3e-f14df211308d req-6f49c5ae-6745-4ba0-90d7-194d0cb9c5cf tempest-VolumesSnapshotsTestJSON-1912821165 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:43 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-8dbffd52-700a-45c5-8b3e-f14df211308d req-6f49c5ae-6745-4ba0-90d7-194d0cb9c5cf tempest-VolumesSnapshotsTestJSON-1912821165 None] Deleted volume successfully. Sep 28 17:19:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-8dbffd52-700a-45c5-8b3e-f14df211308d req-6f49c5ae-6745-4ba0-90d7-194d0cb9c5cf tempest-VolumesSnapshotsTestJSON-1912821165 None] Lock "cinder-25708a72-263a-46ee-8258-752ff157d336-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:48 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-c9371c6b-739b-4a75-bd9d-43efb5fb28f9 req-6c4c4fc7-96d9-4c96-a873-928a58b17a83 tempest-TestShelveInstance-496333506 None] Terminate volume connection completed successfully. Sep 28 17:19:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-c9371c6b-739b-4a75-bd9d-43efb5fb28f9 req-6c4c4fc7-96d9-4c96-a873-928a58b17a83 tempest-TestShelveInstance-496333506 None] Deleting attachment b21b9b96-7b03-4b80-88a2-9a360a983c2d. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:19:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-bb7cdd3a-04a8-4891-bd2d-b012175ec9d9 req-586e00b8-87dc-438d-ac01-7d4a8dcfbfb9 tempest-TestShelveInstance-496333506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-bb7cdd3a-04a8-4891-bd2d-b012175ec9d9 req-586e00b8-87dc-438d-ac01-7d4a8dcfbfb9 tempest-TestShelveInstance-496333506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-bb7cdd3a-04a8-4891-bd2d-b012175ec9d9 req-586e00b8-87dc-438d-ac01-7d4a8dcfbfb9 tempest-TestShelveInstance-496333506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:52 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-bb7cdd3a-04a8-4891-bd2d-b012175ec9d9 req-586e00b8-87dc-438d-ac01-7d4a8dcfbfb9 tempest-TestShelveInstance-496333506 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-196b417e-7d23-4af6-aa8c-2d1346c25dad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2948823f-766c-44f6-b8b4-4a9fa4c6ad54', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:19:52 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-bb7cdd3a-04a8-4891-bd2d-b012175ec9d9 req-586e00b8-87dc-438d-ac01-7d4a8dcfbfb9 tempest-TestShelveInstance-496333506 None] attachment_update completed successfully. Sep 28 17:19:59 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-dfeb296a-8ab6-4cad-8e69-bcca8b6f00c7 tempest-GroupsTest-1506914157 None] Group tempest-Group1-850387632: creating Sep 28 17:19:59 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-dfeb296a-8ab6-4cad-8e69-bcca8b6f00c7 tempest-GroupsTest-1506914157 None] Group tempest-Group1-850387632: created successfully Sep 28 17:19:59 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-dfeb296a-8ab6-4cad-8e69-bcca8b6f00c7 tempest-GroupsTest-1506914157 None] Create group completed successfully. Sep 28 17:20:01 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-34cae8a4-f650-45ea-8067-d596b13ee9dc tempest-GroupsTest-1506914157 None] Group tempest-Group2-118892322: creating Sep 28 17:20:01 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-34cae8a4-f650-45ea-8067-d596b13ee9dc tempest-GroupsTest-1506914157 None] Group tempest-Group2-118892322: created successfully Sep 28 17:20:01 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-34cae8a4-f650-45ea-8067-d596b13ee9dc tempest-GroupsTest-1506914157 None] Create group completed successfully. Sep 28 17:20:03 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Flow 'volume_create_manager' (4b579492-2e67-4e8f-b0da-2d6209e1f073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45c5fd0-8636-44bc-a37d-47b82a2efadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45c5fd0-8636-44bc-a37d-47b82a2efadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2022109860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc32de8f-bd48-4f11-8d16-40733a877c63,host='devstack@QuobyteHD#QuobyteHD',id=8aa748b0-ffed-4924-994f-66bf21a674da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e5f5bfe8b7b4050bd32386c0a629649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:03Z,use_quota=True,user_id='312947cd06994b1e869dee90795f888c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8129d94-bf1e-4bb9-92c9-e2144057f805),volume_type_id=b8129d94-bf1e-4bb9-92c9-e2144057f805)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a3f7b6-32ce-424b-ae19-ce9b00a78378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a3f7b6-32ce-424b-ae19-ce9b00a78378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678277c0-463b-4015-b238-dad240ef7e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678277c0-463b-4015-b238-dad240ef7e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aa748b0-ffed-4924-994f-66bf21a674da', 'volume_name': 'volume-8aa748b0-ffed-4924-994f-66bf21a674da', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c97ff083-401e-48cb-b8a7-0316e925dedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c97ff083-401e-48cb-b8a7-0316e925dedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f17cf0-be4f-43f1-b3ba-7ef9ebe80d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:03 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Volume 8aa748b0-ffed-4924-994f-66bf21a674da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aa748b0-ffed-4924-994f-66bf21a674da', 'volume_size': 1} Sep 28 17:20:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dc32de8f-bd48-4f11-8d16-40733a877c63,created_at=2026-09-28T15:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2022109860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc32de8f-bd48-4f11-8d16-40733a877c63,host='devstack@QuobyteHD#QuobyteHD',id=8aa748b0-ffed-4924-994f-66bf21a674da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e5f5bfe8b7b4050bd32386c0a629649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:03Z,use_quota=True,user_id='312947cd06994b1e869dee90795f888c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8129d94-bf1e-4bb9-92c9-e2144057f805),volume_type_id=b8129d94-bf1e-4bb9-92c9-e2144057f805)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Creating volume 8aa748b0-ffed-4924-994f-66bf21a674da {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:03 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:20:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8aa748b0-ffed-4924-994f-66bf21a674da 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:03 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8aa748b0-ffed-4924-994f-66bf21a674da 1073741824 Sep 28 17:20:03 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:04 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8aa748b0-ffed-4924-994f-66bf21a674da 1073741824" returned: 0 in 0.527s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8aa748b0-ffed-4924-994f-66bf21a674da {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:04 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8aa748b0-ffed-4924-994f-66bf21a674da Sep 28 17:20:04 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:04 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8aa748b0-ffed-4924-994f-66bf21a674da" returned: 0 in 0.303s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f17cf0-be4f-43f1-b3ba-7ef9ebe80d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aa748b0-ffed-4924-994f-66bf21a674da', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b70b70-fa68-48d0-9c62-a933bc2120c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:04 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Volume volume-8aa748b0-ffed-4924-994f-66bf21a674da (8aa748b0-ffed-4924-994f-66bf21a674da): created successfully Sep 28 17:20:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b70b70-fa68-48d0-9c62-a933bc2120c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Flow 'volume_create_manager' (4b579492-2e67-4e8f-b0da-2d6209e1f073) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:04 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-f19ed595-86ff-4c24-98fb-596ac6b425d6 tempest-GroupsTest-1506914157 None] Created volume successfully. Sep 28 17:20:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-08cb87d0-bfd6-47c4-b4f3-e95c8b42af23 tempest-GroupsTest-1506914157 None] Acquiring lock "cinder-quobyte-8aa748b0-ffed-4924-994f-66bf21a674da" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-08cb87d0-bfd6-47c4-b4f3-e95c8b42af23 tempest-GroupsTest-1506914157 None] Lock "cinder-quobyte-8aa748b0-ffed-4924-994f-66bf21a674da" acquired by "delete_volume" :: waited 0.029s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:05 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[474b6fc2-b7d8-4945-af04-968a2a6ce3b4]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08cb87d0-bfd6-47c4-b4f3-e95c8b42af23 tempest-GroupsTest-1506914157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8aa748b0-ffed-4924-994f-66bf21a674da {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:05 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8aa748b0-ffed-4924-994f-66bf21a674da Sep 28 17:20:05 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:06 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08cb87d0-bfd6-47c4-b4f3-e95c8b42af23 tempest-GroupsTest-1506914157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8aa748b0-ffed-4924-994f-66bf21a674da" returned: 0 in 0.518s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08cb87d0-bfd6-47c4-b4f3-e95c8b42af23 tempest-GroupsTest-1506914157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8aa748b0-ffed-4924-994f-66bf21a674da {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:06 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8aa748b0-ffed-4924-994f-66bf21a674da Sep 28 17:20:06 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:06 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08cb87d0-bfd6-47c4-b4f3-e95c8b42af23 tempest-GroupsTest-1506914157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8aa748b0-ffed-4924-994f-66bf21a674da" returned: 0 in 0.441s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-08cb87d0-bfd6-47c4-b4f3-e95c8b42af23 tempest-GroupsTest-1506914157 None] Lock "cinder-quobyte-8aa748b0-ffed-4924-994f-66bf21a674da" released by "delete_volume" :: held 1.040s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:06 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-08cb87d0-bfd6-47c4-b4f3-e95c8b42af23 tempest-GroupsTest-1506914157 None] Created reservations ['05cd7695-d04a-4d68-96dc-c31b7a8ea767'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:06 devstack cinder-volume[87061]: WARNING cinder.quota [None req-08cb87d0-bfd6-47c4-b4f3-e95c8b42af23 tempest-GroupsTest-1506914157 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-981566640 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-981566640, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:20:06 devstack cinder-volume[87061]: WARNING cinder.quota [None req-08cb87d0-bfd6-47c4-b4f3-e95c8b42af23 tempest-GroupsTest-1506914157 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-981566640 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-981566640, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:20:06 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-08cb87d0-bfd6-47c4-b4f3-e95c8b42af23 tempest-GroupsTest-1506914157 None] Created reservations ['49889cb1-7aca-4b1b-8267-234b9b8318cb', '3f22825b-759e-4e9c-9fe2-e0111096decc', '67731d39-8db0-41bd-8270-4e2036715169', 'ea9b313b-5e1b-4766-a4b0-912aca2526ca'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:20:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:06 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:20:06 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08cb87d0-bfd6-47c4-b4f3-e95c8b42af23 tempest-GroupsTest-1506914157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08cb87d0-bfd6-47c4-b4f3-e95c8b42af23 tempest-GroupsTest-1506914157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-08cb87d0-bfd6-47c4-b4f3-e95c8b42af23 tempest-GroupsTest-1506914157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-08cb87d0-bfd6-47c4-b4f3-e95c8b42af23 tempest-GroupsTest-1506914157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08cb87d0-bfd6-47c4-b4f3-e95c8b42af23 tempest-GroupsTest-1506914157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08cb87d0-bfd6-47c4-b4f3-e95c8b42af23 tempest-GroupsTest-1506914157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:07 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:20:07 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:07 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.469s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:20:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:20:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:20:07 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08cb87d0-bfd6-47c4-b4f3-e95c8b42af23 tempest-GroupsTest-1506914157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.334s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-08cb87d0-bfd6-47c4-b4f3-e95c8b42af23 tempest-GroupsTest-1506914157 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:07 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-08cb87d0-bfd6-47c4-b4f3-e95c8b42af23 tempest-GroupsTest-1506914157 None] Delete group completed successfully. Sep 28 17:20:08 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-e9f924b0-7707-4f33-a08c-1727bde8b51d tempest-GroupsTest-1506914157 None] Created reservations ['6d773c5e-8e11-46dd-9109-3b9b1557f982'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e9f924b0-7707-4f33-a08c-1727bde8b51d tempest-GroupsTest-1506914157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e9f924b0-7707-4f33-a08c-1727bde8b51d tempest-GroupsTest-1506914157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e9f924b0-7707-4f33-a08c-1727bde8b51d tempest-GroupsTest-1506914157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e9f924b0-7707-4f33-a08c-1727bde8b51d tempest-GroupsTest-1506914157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e9f924b0-7707-4f33-a08c-1727bde8b51d tempest-GroupsTest-1506914157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e9f924b0-7707-4f33-a08c-1727bde8b51d tempest-GroupsTest-1506914157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:08 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:20:08 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:08 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e9f924b0-7707-4f33-a08c-1727bde8b51d tempest-GroupsTest-1506914157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.407s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:08 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-e9f924b0-7707-4f33-a08c-1727bde8b51d tempest-GroupsTest-1506914157 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:08 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e9f924b0-7707-4f33-a08c-1727bde8b51d tempest-GroupsTest-1506914157 None] Delete group completed successfully. Sep 28 17:20:10 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-51ab8605-40e7-4acf-937f-f4c995f9f4ab tempest-GroupsTest-1506914157 None] Group tempest-GroupsTest-Group-19520197: creating Sep 28 17:20:10 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-51ab8605-40e7-4acf-937f-f4c995f9f4ab tempest-GroupsTest-1506914157 None] Group tempest-GroupsTest-Group-19520197: created successfully Sep 28 17:20:10 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-51ab8605-40e7-4acf-937f-f4c995f9f4ab tempest-GroupsTest-1506914157 None] Create group completed successfully. Sep 28 17:20:12 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Flow 'volume_create_manager' (b5f11046-8006-43f8-b3f2-6f1b3ea08587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eeabfb6-895f-402e-a6ad-318d48c37732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eeabfb6-895f-402e-a6ad-318d48c37732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-942961188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3d9f4a8c-e021-4b9e-b519-2eb8add94d41,host='devstack@QuobyteHD#QuobyteHD',id=757da294-8663-4fda-89bd-3628c807f3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e5f5bfe8b7b4050bd32386c0a629649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:13Z,use_quota=True,user_id='312947cd06994b1e869dee90795f888c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e4012fd-bb67-498e-95ce-306ed65b319c),volume_type_id=4e4012fd-bb67-498e-95ce-306ed65b319c)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80696f4f-834e-4b65-a5d6-90139994546e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80696f4f-834e-4b65-a5d6-90139994546e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb823188-12aa-48b8-9f55-e66c39d4050a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb823188-12aa-48b8-9f55-e66c39d4050a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '757da294-8663-4fda-89bd-3628c807f3d8', 'volume_name': 'volume-757da294-8663-4fda-89bd-3628c807f3d8', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169d0de0-c137-4994-ac0a-4aed6b616043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169d0de0-c137-4994-ac0a-4aed6b616043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb1028f-0573-4d26-95f8-f47d24e47349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:12 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Volume 757da294-8663-4fda-89bd-3628c807f3d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-757da294-8663-4fda-89bd-3628c807f3d8', 'volume_size': 1} Sep 28 17:20:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3d9f4a8c-e021-4b9e-b519-2eb8add94d41,created_at=2026-09-28T15:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-942961188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3d9f4a8c-e021-4b9e-b519-2eb8add94d41,host='devstack@QuobyteHD#QuobyteHD',id=757da294-8663-4fda-89bd-3628c807f3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e5f5bfe8b7b4050bd32386c0a629649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:13Z,use_quota=True,user_id='312947cd06994b1e869dee90795f888c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e4012fd-bb67-498e-95ce-306ed65b319c),volume_type_id=4e4012fd-bb67-498e-95ce-306ed65b319c)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Creating volume 757da294-8663-4fda-89bd-3628c807f3d8 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:12 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:20:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-757da294-8663-4fda-89bd-3628c807f3d8 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:12 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-757da294-8663-4fda-89bd-3628c807f3d8 1073741824 Sep 28 17:20:12 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:13 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-757da294-8663-4fda-89bd-3628c807f3d8 1073741824" returned: 0 in 0.695s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-757da294-8663-4fda-89bd-3628c807f3d8 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:13 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-757da294-8663-4fda-89bd-3628c807f3d8 Sep 28 17:20:13 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:14 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-757da294-8663-4fda-89bd-3628c807f3d8" returned: 0 in 0.474s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:14 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:14 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb1028f-0573-4d26-95f8-f47d24e47349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-757da294-8663-4fda-89bd-3628c807f3d8', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:14 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (278ee72b-0499-4e75-9b5e-85de93e48ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:14 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Volume volume-757da294-8663-4fda-89bd-3628c807f3d8 (757da294-8663-4fda-89bd-3628c807f3d8): created successfully Sep 28 17:20:14 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (278ee72b-0499-4e75-9b5e-85de93e48ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:14 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Flow 'volume_create_manager' (b5f11046-8006-43f8-b3f2-6f1b3ea08587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:14 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-19a873f4-2bc9-4404-bc83-a66ac5c371c6 tempest-GroupsTest-1506914157 None] Created volume successfully. Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Flow 'volume_create_manager' (0b67af8c-b3d6-4453-a23f-f2e1f35418f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3b8292-93c9-44c1-adc3-c37115a0362e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3b8292-93c9-44c1-adc3-c37115a0362e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-241308463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3d9f4a8c-e021-4b9e-b519-2eb8add94d41,host='devstack@QuobyteHD#QuobyteHD',id=3fbe6202-2450-48d5-9c1f-dd892f919034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e5f5bfe8b7b4050bd32386c0a629649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:16Z,use_quota=True,user_id='312947cd06994b1e869dee90795f888c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e4012fd-bb67-498e-95ce-306ed65b319c),volume_type_id=4e4012fd-bb67-498e-95ce-306ed65b319c)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c419b5e-1172-4cac-b3f0-225a1811f94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c419b5e-1172-4cac-b3f0-225a1811f94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42485653-5ab3-4718-9bbb-c8dcb61b945f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42485653-5ab3-4718-9bbb-c8dcb61b945f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fbe6202-2450-48d5-9c1f-dd892f919034', 'volume_name': 'volume-3fbe6202-2450-48d5-9c1f-dd892f919034', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa07ab7-7ed6-42f5-82fc-be33888cabd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa07ab7-7ed6-42f5-82fc-be33888cabd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48aed51-9e78-4995-b7c9-fe9da958d769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Volume 3fbe6202-2450-48d5-9c1f-dd892f919034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fbe6202-2450-48d5-9c1f-dd892f919034', 'volume_size': 1} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3d9f4a8c-e021-4b9e-b519-2eb8add94d41,created_at=2026-09-28T15:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-241308463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3d9f4a8c-e021-4b9e-b519-2eb8add94d41,host='devstack@QuobyteHD#QuobyteHD',id=3fbe6202-2450-48d5-9c1f-dd892f919034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e5f5bfe8b7b4050bd32386c0a629649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:16Z,use_quota=True,user_id='312947cd06994b1e869dee90795f888c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e4012fd-bb67-498e-95ce-306ed65b319c),volume_type_id=4e4012fd-bb67-498e-95ce-306ed65b319c)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Creating volume 3fbe6202-2450-48d5-9c1f-dd892f919034 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:16 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fbe6202-2450-48d5-9c1f-dd892f919034 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:16 devstack sudo[102840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fbe6202-2450-48d5-9c1f-dd892f919034 1073741824 Sep 28 17:20:16 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Flow 'volume_create_manager' (4026d67b-a829-40de-9e8e-88c6f77ee2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59008054-6724-4b5c-a766-13b485454462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59008054-6724-4b5c-a766-13b485454462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2092073640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f98e101-6a61-4981-aa69-b93ccc2a6ab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e382e96f024378b3148c1c09ee358a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:16Z,use_quota=True,user_id='d7bac45041754cbf8eeb9d5a17473ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4a99f6-4655-4bd2-aceb-d4b6c4c6fdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4a99f6-4655-4bd2-aceb-d4b6c4c6fdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88920436-8b2c-48a5-a4c3-73dae202d929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88920436-8b2c-48a5-a4c3-73dae202d929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f98e101-6a61-4981-aa69-b93ccc2a6ab2', 'volume_name': 'volume-8f98e101-6a61-4981-aa69-b93ccc2a6ab2', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a27485-5ddd-4ba0-b11a-b771cb948183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a27485-5ddd-4ba0-b11a-b771cb948183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce2b16b-ca8a-4833-a9d5-279ee466e0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Volume 8f98e101-6a61-4981-aa69-b93ccc2a6ab2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f98e101-6a61-4981-aa69-b93ccc2a6ab2', 'volume_size': 1} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Flow 'volume_create_manager' (f0511cbe-57e0-4705-8a18-b1033df1f43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ebc2fc-d6d1-468e-b619-1356cc23b768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ebc2fc-d6d1-468e-b619-1356cc23b768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-706864059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf83138-0e35-4c81-b465-b0533ec18eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e382e96f024378b3148c1c09ee358a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:17Z,use_quota=True,user_id='d7bac45041754cbf8eeb9d5a17473ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d743fb81-eb22-4ac9-9266-106550c96696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d743fb81-eb22-4ac9-9266-106550c96696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6016724-dd7d-4a34-901b-8ec15ad6cf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6016724-dd7d-4a34-901b-8ec15ad6cf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bf83138-0e35-4c81-b465-b0533ec18eb2', 'volume_name': 'volume-0bf83138-0e35-4c81-b465-b0533ec18eb2', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd59f94a-143f-45d7-8536-926b39cc16e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd59f94a-143f-45d7-8536-926b39cc16e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00928842-4309-47c0-a1b9-143607cadfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Volume 0bf83138-0e35-4c81-b465-b0533ec18eb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bf83138-0e35-4c81-b465-b0533ec18eb2', 'volume_size': 1} Sep 28 17:20:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:17 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fbe6202-2450-48d5-9c1f-dd892f919034 1073741824" returned: 0 in 0.781s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fbe6202-2450-48d5-9c1f-dd892f919034 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:17 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fbe6202-2450-48d5-9c1f-dd892f919034 Sep 28 17:20:17 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:17 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fbe6202-2450-48d5-9c1f-dd892f919034" returned: 0 in 0.367s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2092073640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f98e101-6a61-4981-aa69-b93ccc2a6ab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e382e96f024378b3148c1c09ee358a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:16Z,use_quota=True,user_id='d7bac45041754cbf8eeb9d5a17473ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Creating volume 8f98e101-6a61-4981-aa69-b93ccc2a6ab2 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:17 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:20:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f98e101-6a61-4981-aa69-b93ccc2a6ab2 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:17 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f98e101-6a61-4981-aa69-b93ccc2a6ab2 1073741824 Sep 28 17:20:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48aed51-9e78-4995-b7c9-fe9da958d769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fbe6202-2450-48d5-9c1f-dd892f919034', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:17 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8097628-f576-48dc-b4dc-d71d1c881478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:17 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Volume volume-3fbe6202-2450-48d5-9c1f-dd892f919034 (3fbe6202-2450-48d5-9c1f-dd892f919034): created successfully Sep 28 17:20:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8097628-f576-48dc-b4dc-d71d1c881478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Flow 'volume_create_manager' (0b67af8c-b3d6-4453-a23f-f2e1f35418f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:17 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d5468d9a-a551-4d1f-b52e-3877edb1cf63 tempest-GroupsTest-1506914157 None] Created volume successfully. Sep 28 17:20:18 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f98e101-6a61-4981-aa69-b93ccc2a6ab2 1073741824" returned: 0 in 0.649s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f98e101-6a61-4981-aa69-b93ccc2a6ab2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:18 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f98e101-6a61-4981-aa69-b93ccc2a6ab2 Sep 28 17:20:18 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:18 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f98e101-6a61-4981-aa69-b93ccc2a6ab2" returned: 0 in 0.381s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:18 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.718s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:18 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-706864059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf83138-0e35-4c81-b465-b0533ec18eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e382e96f024378b3148c1c09ee358a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:17Z,use_quota=True,user_id='d7bac45041754cbf8eeb9d5a17473ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:18 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Creating volume 0bf83138-0e35-4c81-b465-b0533ec18eb2 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:18 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:18 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:18 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:18 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:20:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0bf83138-0e35-4c81-b465-b0533ec18eb2 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:18 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0bf83138-0e35-4c81-b465-b0533ec18eb2 1073741824 Sep 28 17:20:18 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce2b16b-ca8a-4833-a9d5-279ee466e0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f98e101-6a61-4981-aa69-b93ccc2a6ab2', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed11a7d1-ac8b-49fa-a4ca-473ef9e6eb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:18 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Volume volume-8f98e101-6a61-4981-aa69-b93ccc2a6ab2 (8f98e101-6a61-4981-aa69-b93ccc2a6ab2): created successfully Sep 28 17:20:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed11a7d1-ac8b-49fa-a4ca-473ef9e6eb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Flow 'volume_create_manager' (4026d67b-a829-40de-9e8e-88c6f77ee2a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:18 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-b6b63c45-e5e8-41b5-93b5-ee7b3d6cca4e tempest-TestServerVolumeAttachmentScenario-669836961 None] Created volume successfully. Sep 28 17:20:18 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-24ec3f68-1af9-49db-9e7f-2e979d0526a5 tempest-GroupsTest-1506914157 None] Update group completed successfully. Sep 28 17:20:19 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0bf83138-0e35-4c81-b465-b0533ec18eb2 1073741824" returned: 0 in 0.630s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0bf83138-0e35-4c81-b465-b0533ec18eb2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:19 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0bf83138-0e35-4c81-b465-b0533ec18eb2 Sep 28 17:20:19 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:19 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0bf83138-0e35-4c81-b465-b0533ec18eb2" returned: 0 in 0.293s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00928842-4309-47c0-a1b9-143607cadfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bf83138-0e35-4c81-b465-b0533ec18eb2', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a7269a-1aaf-4f1d-9bf7-aae5d078df3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:19 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Volume volume-0bf83138-0e35-4c81-b465-b0533ec18eb2 (0bf83138-0e35-4c81-b465-b0533ec18eb2): created successfully Sep 28 17:20:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a7269a-1aaf-4f1d-9bf7-aae5d078df3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Flow 'volume_create_manager' (f0511cbe-57e0-4705-8a18-b1033df1f43f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:19 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-7c76b5fe-b81b-4bee-9fdf-c1650f854b08 tempest-TestServerVolumeAttachmentScenario-669836961 None] Created volume successfully. Sep 28 17:20:20 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-c0a022c7-e5c0-4096-b31e-b2c3ca159eed tempest-GroupsTest-1506914157 None] Update group completed successfully. Sep 28 17:20:22 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Acquiring lock "cinder-quobyte-3fbe6202-2450-48d5-9c1f-dd892f919034" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:22 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Lock "cinder-quobyte-3fbe6202-2450-48d5-9c1f-dd892f919034" acquired by "delete_volume" :: waited 0.032s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:22 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[d482aa32-d0cb-4bf1-a264-8b4cd2efc52d]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fbe6202-2450-48d5-9c1f-dd892f919034 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:22 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fbe6202-2450-48d5-9c1f-dd892f919034 Sep 28 17:20:22 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:22 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fbe6202-2450-48d5-9c1f-dd892f919034" returned: 0 in 0.556s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fbe6202-2450-48d5-9c1f-dd892f919034 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:23 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fbe6202-2450-48d5-9c1f-dd892f919034 Sep 28 17:20:23 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:23 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fbe6202-2450-48d5-9c1f-dd892f919034" returned: 0 in 0.374s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Lock "cinder-quobyte-3fbe6202-2450-48d5-9c1f-dd892f919034" released by "delete_volume" :: held 1.010s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Acquiring lock "cinder-quobyte-757da294-8663-4fda-89bd-3628c807f3d8" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Lock "cinder-quobyte-757da294-8663-4fda-89bd-3628c807f3d8" acquired by "delete_volume" :: waited 0.019s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:23 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b773c15-a501-488b-9d7b-e7ae843da99a]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-757da294-8663-4fda-89bd-3628c807f3d8 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:23 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-757da294-8663-4fda-89bd-3628c807f3d8 Sep 28 17:20:23 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:23 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-757da294-8663-4fda-89bd-3628c807f3d8" returned: 0 in 0.463s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-757da294-8663-4fda-89bd-3628c807f3d8 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:23 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-757da294-8663-4fda-89bd-3628c807f3d8 Sep 28 17:20:23 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:24 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-757da294-8663-4fda-89bd-3628c807f3d8" returned: 0 in 0.294s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Lock "cinder-quobyte-757da294-8663-4fda-89bd-3628c807f3d8" released by "delete_volume" :: held 0.822s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:24 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Created reservations ['e0967ae0-5a15-4d2f-abfe-50577a8762aa'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:24 devstack cinder-volume[87061]: WARNING cinder.quota [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-131748300 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-131748300, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:20:24 devstack cinder-volume[87061]: WARNING cinder.quota [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-131748300 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-131748300, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:20:24 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Created reservations ['fc674033-227e-43b7-a424-dc88bb018f37', '1661467e-6f25-491f-bc6d-a87a933a9ffa', '0c2a8819-1620-4517-8984-66c6b23d1e85', '6183562e-9c8d-42f4-b5e5-09606453063a'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:24 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Created reservations ['e127013c-edd4-4149-ae33-698be243085e', '2d72590e-c3e0-4f6c-8339-1c02c45cfd47', '331efaed-2778-4c54-8432-0199d45196b2', '27fa03ea-42da-44ed-9a7f-4070e58b0921'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:24 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:20:24 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.380s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:25 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:25 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:25 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-4f01c32e-c7f1-4034-a02d-67bc6372e98a tempest-GroupsTest-1506914157 None] Delete group completed successfully. Sep 28 17:20:33 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:UPDATE=76,cinder:SELECT=72,cinder:DELETE=5,cinder:INSERT=14 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:20:33 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e2593047-be00-489f-8492-7fe68c4512f3 tempest-GroupsV320Test-622668882 None] Group tempest-GroupsV320Test-Group-1584879272: creating Sep 28 17:20:33 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e2593047-be00-489f-8492-7fe68c4512f3 tempest-GroupsV320Test-622668882 None] Group tempest-GroupsV320Test-Group-1584879272: created successfully Sep 28 17:20:33 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e2593047-be00-489f-8492-7fe68c4512f3 tempest-GroupsV320Test-622668882 None] Create group completed successfully. Sep 28 17:20:35 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=66,cinder:UPDATE=64,cinder:INSERT=15,cinder:DELETE=3 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:20:35 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-d570e1ca-8127-43b0-bb65-6f6e461c62bf tempest-GroupsV320Test-622668882 None] Created reservations ['075b57e2-4abd-44c8-8fdd-2b77d0d3b447'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d570e1ca-8127-43b0-bb65-6f6e461c62bf tempest-GroupsV320Test-622668882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d570e1ca-8127-43b0-bb65-6f6e461c62bf tempest-GroupsV320Test-622668882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d570e1ca-8127-43b0-bb65-6f6e461c62bf tempest-GroupsV320Test-622668882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d570e1ca-8127-43b0-bb65-6f6e461c62bf tempest-GroupsV320Test-622668882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d570e1ca-8127-43b0-bb65-6f6e461c62bf tempest-GroupsV320Test-622668882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d570e1ca-8127-43b0-bb65-6f6e461c62bf tempest-GroupsV320Test-622668882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:35 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:20:35 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:35 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d570e1ca-8127-43b0-bb65-6f6e461c62bf tempest-GroupsV320Test-622668882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.293s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:35 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-d570e1ca-8127-43b0-bb65-6f6e461c62bf tempest-GroupsV320Test-622668882 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:35 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d570e1ca-8127-43b0-bb65-6f6e461c62bf tempest-GroupsV320Test-622668882 None] Delete group completed successfully. Sep 28 17:20:42 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-aaf06604-8feb-4974-927d-88e0aa95eb8e req-3e6a4f17-c2f4-490c-a0fe-02c1c4b6e754 tempest-TestShelveInstance-496333506 None] Terminate volume connection completed successfully. Sep 28 17:20:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-aaf06604-8feb-4974-927d-88e0aa95eb8e req-3e6a4f17-c2f4-490c-a0fe-02c1c4b6e754 tempest-TestShelveInstance-496333506 None] Deleting attachment 2948823f-766c-44f6-b8b4-4a9fa4c6ad54. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:20:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-aaf06604-8feb-4974-927d-88e0aa95eb8e req-157a79c1-b77e-4cfb-b64a-109abd0bc613 tempest-TestShelveInstance-496333506 None] Acquiring lock "cinder-196b417e-7d23-4af6-aa8c-2d1346c25dad-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-aaf06604-8feb-4974-927d-88e0aa95eb8e req-157a79c1-b77e-4cfb-b64a-109abd0bc613 tempest-TestShelveInstance-496333506 None] Lock "cinder-196b417e-7d23-4af6-aa8c-2d1346c25dad-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-aaf06604-8feb-4974-927d-88e0aa95eb8e req-157a79c1-b77e-4cfb-b64a-109abd0bc613 tempest-TestShelveInstance-496333506 None] Acquiring lock "cinder-quobyte-196b417e-7d23-4af6-aa8c-2d1346c25dad" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-aaf06604-8feb-4974-927d-88e0aa95eb8e req-157a79c1-b77e-4cfb-b64a-109abd0bc613 tempest-TestShelveInstance-496333506 None] Lock "cinder-quobyte-196b417e-7d23-4af6-aa8c-2d1346c25dad" acquired by "delete_volume" :: waited 0.024s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:43 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeececc-ad0a-4531-8c35-e456f91d889e]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-aaf06604-8feb-4974-927d-88e0aa95eb8e req-157a79c1-b77e-4cfb-b64a-109abd0bc613 tempest-TestShelveInstance-496333506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-196b417e-7d23-4af6-aa8c-2d1346c25dad {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:43 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-196b417e-7d23-4af6-aa8c-2d1346c25dad Sep 28 17:20:43 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:43 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-aaf06604-8feb-4974-927d-88e0aa95eb8e req-157a79c1-b77e-4cfb-b64a-109abd0bc613 tempest-TestShelveInstance-496333506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-196b417e-7d23-4af6-aa8c-2d1346c25dad" returned: 0 in 0.602s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-aaf06604-8feb-4974-927d-88e0aa95eb8e req-157a79c1-b77e-4cfb-b64a-109abd0bc613 tempest-TestShelveInstance-496333506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-196b417e-7d23-4af6-aa8c-2d1346c25dad {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:43 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-196b417e-7d23-4af6-aa8c-2d1346c25dad Sep 28 17:20:43 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:44 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-aaf06604-8feb-4974-927d-88e0aa95eb8e req-157a79c1-b77e-4cfb-b64a-109abd0bc613 tempest-TestShelveInstance-496333506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-196b417e-7d23-4af6-aa8c-2d1346c25dad" returned: 0 in 0.309s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-aaf06604-8feb-4974-927d-88e0aa95eb8e req-157a79c1-b77e-4cfb-b64a-109abd0bc613 tempest-TestShelveInstance-496333506 None] Lock "cinder-quobyte-196b417e-7d23-4af6-aa8c-2d1346c25dad" released by "delete_volume" :: held 0.981s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:44 devstack cinder-volume[87061]: DEBUG cinder.quota [req-aaf06604-8feb-4974-927d-88e0aa95eb8e req-157a79c1-b77e-4cfb-b64a-109abd0bc613 tempest-TestShelveInstance-496333506 None] Created reservations ['c1fa450f-443f-4ef8-8067-dbe8d5a13af5', '39bc354b-0c86-496e-87e3-c55ab76a6410', '51505977-c4b8-4f4f-8d7c-c5287c0e1eef', 'e8d99884-a6e8-41a8-b17c-9c40384b535d'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-aaf06604-8feb-4974-927d-88e0aa95eb8e req-157a79c1-b77e-4cfb-b64a-109abd0bc613 tempest-TestShelveInstance-496333506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-aaf06604-8feb-4974-927d-88e0aa95eb8e req-157a79c1-b77e-4cfb-b64a-109abd0bc613 tempest-TestShelveInstance-496333506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [req-aaf06604-8feb-4974-927d-88e0aa95eb8e req-157a79c1-b77e-4cfb-b64a-109abd0bc613 tempest-TestShelveInstance-496333506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [req-aaf06604-8feb-4974-927d-88e0aa95eb8e req-157a79c1-b77e-4cfb-b64a-109abd0bc613 tempest-TestShelveInstance-496333506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-aaf06604-8feb-4974-927d-88e0aa95eb8e req-157a79c1-b77e-4cfb-b64a-109abd0bc613 tempest-TestShelveInstance-496333506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-aaf06604-8feb-4974-927d-88e0aa95eb8e req-157a79c1-b77e-4cfb-b64a-109abd0bc613 tempest-TestShelveInstance-496333506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:44 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:20:44 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:44 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [req-aaf06604-8feb-4974-927d-88e0aa95eb8e req-157a79c1-b77e-4cfb-b64a-109abd0bc613 tempest-TestShelveInstance-496333506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.294s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:44 devstack cinder-volume[87061]: DEBUG cinder.manager [req-aaf06604-8feb-4974-927d-88e0aa95eb8e req-157a79c1-b77e-4cfb-b64a-109abd0bc613 tempest-TestShelveInstance-496333506 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:44 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-aaf06604-8feb-4974-927d-88e0aa95eb8e req-157a79c1-b77e-4cfb-b64a-109abd0bc613 tempest-TestShelveInstance-496333506 None] Deleted volume successfully. Sep 28 17:20:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [req-aaf06604-8feb-4974-927d-88e0aa95eb8e req-157a79c1-b77e-4cfb-b64a-109abd0bc613 tempest-TestShelveInstance-496333506 None] Lock "cinder-196b417e-7d23-4af6-aa8c-2d1346c25dad-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:54 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=12,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:20:54 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=11,cinder:UPDATE=11,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:20:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-c91535be-cb44-47fd-8bd9-bc689ba6f4ce req-225b88d1-be4e-4aea-8f63-d379339456f4 tempest-TestServerVolumeAttachmentScenario-669836961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-c91535be-cb44-47fd-8bd9-bc689ba6f4ce req-225b88d1-be4e-4aea-8f63-d379339456f4 tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-c91535be-cb44-47fd-8bd9-bc689ba6f4ce req-225b88d1-be4e-4aea-8f63-d379339456f4 tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-c91535be-cb44-47fd-8bd9-bc689ba6f4ce req-225b88d1-be4e-4aea-8f63-d379339456f4 tempest-TestServerVolumeAttachmentScenario-669836961 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-8f98e101-6a61-4981-aa69-b93ccc2a6ab2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b78733f7-1c6e-416d-84f2-2c044b483eef', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:20:55 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-c91535be-cb44-47fd-8bd9-bc689ba6f4ce req-225b88d1-be4e-4aea-8f63-d379339456f4 tempest-TestServerVolumeAttachmentScenario-669836961 None] attachment_update completed successfully. Sep 28 17:21:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-0cfbb84d-b223-4e28-964e-abf0c168a834 req-82b348ce-11c0-4c17-98b8-0dee81d5edad tempest-TestServerVolumeAttachmentScenario-669836961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-0cfbb84d-b223-4e28-964e-abf0c168a834 req-82b348ce-11c0-4c17-98b8-0dee81d5edad tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-0cfbb84d-b223-4e28-964e-abf0c168a834 req-82b348ce-11c0-4c17-98b8-0dee81d5edad tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-0cfbb84d-b223-4e28-964e-abf0c168a834 req-82b348ce-11c0-4c17-98b8-0dee81d5edad tempest-TestServerVolumeAttachmentScenario-669836961 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-0bf83138-0e35-4c81-b465-b0533ec18eb2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54cc114d-5c1d-4632-b514-b82ddba3d55b', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:21:02 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-0cfbb84d-b223-4e28-964e-abf0c168a834 req-82b348ce-11c0-4c17-98b8-0dee81d5edad tempest-TestServerVolumeAttachmentScenario-669836961 None] attachment_update completed successfully. Sep 28 17:21:03 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Flow 'volume_create_manager' (92a9eaf4-1206-44e7-85e9-2b9d8a82fd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22fce6eb-fa7d-4f3a-b81f-52bcdd3d5ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22fce6eb-fa7d-4f3a-b81f-52bcdd3d5ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1534417816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5899a4ce-6da8-4ba7-bd77-b39a597e0350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9aa7d67cf9480b835753c3a2829d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:04Z,use_quota=True,user_id='149b8783e2bd40f8b7443da847940913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57be7c69-69a9-483b-8964-9c5839ca163f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57be7c69-69a9-483b-8964-9c5839ca163f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86bd111c-c5d7-4a14-8bed-340bd787d91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86bd111c-c5d7-4a14-8bed-340bd787d91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5899a4ce-6da8-4ba7-bd77-b39a597e0350', 'volume_name': 'volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ba62c2-71e6-478c-b7c4-5b53d1c36c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ba62c2-71e6-478c-b7c4-5b53d1c36c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3508b8d0-941a-4868-9f33-680d71f040eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:03 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Volume 5899a4ce-6da8-4ba7-bd77-b39a597e0350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350', 'volume_size': 1} Sep 28 17:21:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1534417816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5899a4ce-6da8-4ba7-bd77-b39a597e0350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9aa7d67cf9480b835753c3a2829d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:04Z,use_quota=True,user_id='149b8783e2bd40f8b7443da847940913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Creating volume 5899a4ce-6da8-4ba7-bd77-b39a597e0350 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:03 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:21:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:03 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 1073741824 Sep 28 17:21:03 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:04 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 1073741824" returned: 0 in 0.556s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:04 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 Sep 28 17:21:04 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:04 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350" returned: 0 in 0.330s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3508b8d0-941a-4868-9f33-680d71f040eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b69c25-9077-40af-9ea8-c8bf7bf805d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:04 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Volume volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 (5899a4ce-6da8-4ba7-bd77-b39a597e0350): created successfully Sep 28 17:21:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b69c25-9077-40af-9ea8-c8bf7bf805d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Flow 'volume_create_manager' (92a9eaf4-1206-44e7-85e9-2b9d8a82fd27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:04 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-9796d917-4023-48c7-8729-3ba45be7a5d2 tempest-VolumeDependencyTests-2055984072 None] Created volume successfully. Sep 28 17:21:05 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-331be311-0904-4e78-9271-ddf57e8b0d4c req-5b27b983-5cad-4a98-9b2e-e9e7e1592919 tempest-TestServerVolumeAttachmentScenario-669836961 None] Terminate volume connection completed successfully. Sep 28 17:21:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-331be311-0904-4e78-9271-ddf57e8b0d4c req-5b27b983-5cad-4a98-9b2e-e9e7e1592919 tempest-TestServerVolumeAttachmentScenario-669836961 None] Deleting attachment 54cc114d-5c1d-4632-b514-b82ddba3d55b. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:21:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-74d73dc3-d770-4b98-bd79-f3b2a0df195d tempest-VolumeDependencyTests-2055984072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-74d73dc3-d770-4b98-bd79-f3b2a0df195d tempest-VolumeDependencyTests-2055984072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-74d73dc3-d770-4b98-bd79-f3b2a0df195d tempest-VolumeDependencyTests-2055984072 None] Creating offline snapshot fa2f861d-250c-4011-a9e5-f91170f0e2f0 of volume 5899a4ce-6da8-4ba7-bd77-b39a597e0350 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:21:06 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9496bc-def0-4d38-939b-93833e9846e2]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-74d73dc3-d770-4b98-bd79-f3b2a0df195d tempest-VolumeDependencyTests-2055984072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:06 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 Sep 28 17:21:06 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:06 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-74d73dc3-d770-4b98-bd79-f3b2a0df195d tempest-VolumeDependencyTests-2055984072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350" returned: 0 in 0.528s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-74d73dc3-d770-4b98-bd79-f3b2a0df195d tempest-VolumeDependencyTests-2055984072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:06 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0 1G Sep 28 17:21:06 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:21:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:06 devstack sudo[103601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:21:06 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:07 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.372s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:21:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:21:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:21:07 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-74d73dc3-d770-4b98-bd79-f3b2a0df195d tempest-VolumeDependencyTests-2055984072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0 1G" returned: 0 in 0.702s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-74d73dc3-d770-4b98-bd79-f3b2a0df195d tempest-VolumeDependencyTests-2055984072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:07 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0 Sep 28 17:21:07 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-4343cb4f-3c2f-4bc0-9f3c-676e2ec7271a req-57b30a1e-2769-4e9e-8f8e-117b1e1cb6cb tempest-TestServerVolumeAttachmentScenario-669836961 None] Terminate volume connection completed successfully. Sep 28 17:21:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-4343cb4f-3c2f-4bc0-9f3c-676e2ec7271a req-57b30a1e-2769-4e9e-8f8e-117b1e1cb6cb tempest-TestServerVolumeAttachmentScenario-669836961 None] Deleting attachment b78733f7-1c6e-416d-84f2-2c044b483eef. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:21:07 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:07 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-74d73dc3-d770-4b98-bd79-f3b2a0df195d tempest-VolumeDependencyTests-2055984072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0" returned: 0 in 0.455s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:07 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-74d73dc3-d770-4b98-bd79-f3b2a0df195d tempest-VolumeDependencyTests-2055984072 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0 is being set with open permissions: ugo+rw Sep 28 17:21:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-74d73dc3-d770-4b98-bd79-f3b2a0df195d tempest-VolumeDependencyTests-2055984072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:07 devstack sudo[103643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0 Sep 28 17:21:07 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:08 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-74d73dc3-d770-4b98-bd79-f3b2a0df195d tempest-VolumeDependencyTests-2055984072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0" returned: 0 in 0.322s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-74d73dc3-d770-4b98-bd79-f3b2a0df195d tempest-VolumeDependencyTests-2055984072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:08 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.info Sep 28 17:21:08 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:08 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-74d73dc3-d770-4b98-bd79-f3b2a0df195d tempest-VolumeDependencyTests-2055984072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.info" returned: 0 in 0.390s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:08 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-74d73dc3-d770-4b98-bd79-f3b2a0df195d tempest-VolumeDependencyTests-2055984072 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.info is being set with open permissions: ugo+rw Sep 28 17:21:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-74d73dc3-d770-4b98-bd79-f3b2a0df195d tempest-VolumeDependencyTests-2055984072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:08 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.info Sep 28 17:21:08 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:08 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-74d73dc3-d770-4b98-bd79-f3b2a0df195d tempest-VolumeDependencyTests-2055984072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.info" returned: 0 in 0.429s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-74d73dc3-d770-4b98-bd79-f3b2a0df195d tempest-VolumeDependencyTests-2055984072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.971s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:09 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-74d73dc3-d770-4b98-bd79-f3b2a0df195d tempest-VolumeDependencyTests-2055984072 None] Create snapshot completed successfully Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Flow 'volume_create_manager' (2482a495-6601-4817-aa27-df75d59ac42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a4635a-f147-4536-b3be-32e14167e62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a4635a-f147-4536-b3be-32e14167e62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1374022240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0484ea3f-70eb-440d-ac7b-09ad26985f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9aa7d67cf9480b835753c3a2829d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fa2f861d-250c-4011-a9e5-f91170f0e2f0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:10Z,use_quota=True,user_id='149b8783e2bd40f8b7443da847940913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d39fcc-8674-4451-95b5-d855f3485621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d39fcc-8674-4451-95b5-d855f3485621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec55a03f-330e-479c-890d-ba05fd438623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec55a03f-330e-479c-890d-ba05fd438623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0484ea3f-70eb-440d-ac7b-09ad26985f7b', 'volume_name': 'volume-0484ea3f-70eb-440d-ac7b-09ad26985f7b', 'volume_size': 1, 'snapshot_id': 'fa2f861d-250c-4011-a9e5-f91170f0e2f0'}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c55a644-5b3e-4d39-ae93-a12cae3542d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c55a644-5b3e-4d39-ae93-a12cae3542d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9bac04b-8a35-47ff-ae07-d9a266316020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:10 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Volume 0484ea3f-70eb-440d-ac7b-09ad26985f7b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0484ea3f-70eb-440d-ac7b-09ad26985f7b', 'volume_size': 1, 'snapshot_id': 'fa2f861d-250c-4011-a9e5-f91170f0e2f0'} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Acquiring lock "cinder-quobyte-fa2f861d-250c-4011-a9e5-f91170f0e2f0-0484ea3f-70eb-440d-ac7b-09ad26985f7b" by "_create_volume_from_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Lock "cinder-quobyte-fa2f861d-250c-4011-a9e5-f91170f0e2f0-0484ea3f-70eb-440d-ac7b-09ad26985f7b" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Creating volume 0484ea3f-70eb-440d-ac7b-09ad26985f7b from snapshot fa2f861d-250c-4011-a9e5-f91170f0e2f0 {{(pid=87061) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Acquiring lock "cinder-quobyte-0484ea3f-70eb-440d-ac7b-09ad26985f7b" by "_copy_volume_from_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Lock "cinder-quobyte-0484ea3f-70eb-440d-ac7b-09ad26985f7b" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] snapshot: fa2f861d-250c-4011-a9e5-f91170f0e2f0, volume: 0484ea3f-70eb-440d-ac7b-09ad26985f7b, {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31e83a4-f139-4f4f-acbf-1a470adc8559]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:10 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0 Sep 28 17:21:10 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:10 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0" returned: 0 in 0.468s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15fbe37-31fd-4d1f-bd83-fbe9f7367ae0]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:11 devstack sudo[103719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 Sep 28 17:21:11 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:11 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350" returned: 0 in 0.701s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:21:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Creating direct copy from snapshot {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:21:11 devstack cinder-volume[87061]: DEBUG cinder.utils [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Path /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0484ea3f-70eb-440d-ac7b-09ad26985f7b not found in is_blk_device check {{(pid=87061) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:21:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0484ea3f-70eb-440d-ac7b-09ad26985f7b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:11 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0484ea3f-70eb-440d-ac7b-09ad26985f7b Sep 28 17:21:11 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5487e308-3002-47fa-b636-f95b0267c4f9 tempest-TestServerVolumeAttachmentScenario-669836961 None] Acquiring lock "cinder-0bf83138-0e35-4c81-b465-b0533ec18eb2-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5487e308-3002-47fa-b636-f95b0267c4f9 tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "cinder-0bf83138-0e35-4c81-b465-b0533ec18eb2-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:14 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:14 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Flow 'volume_create_manager' (e4a3e2f5-452a-4318-b2d4-11d3e0c541a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:14 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d5c55e-03a2-4c15-8657-c956cc14f2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5487e308-3002-47fa-b636-f95b0267c4f9 tempest-TestServerVolumeAttachmentScenario-669836961 None] Acquiring lock "cinder-quobyte-0bf83138-0e35-4c81-b465-b0533ec18eb2" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:14 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d5c55e-03a2-4c15-8657-c956cc14f2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-947120301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c677b15-c1dd-473b-9a66-2a1484f651cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='276582b7276c49cf91fecce938d3acf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:15Z,use_quota=True,user_id='72b07fb8613641a2a8fd81c07aa95da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:14 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c37c7a2-e289-4d77-a9ab-7ce4c2c0ce20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:14 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c37c7a2-e289-4d77-a9ab-7ce4c2c0ce20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:14 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0344a951-0953-4225-b639-2b0107e58036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:14 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0344a951-0953-4225-b639-2b0107e58036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c677b15-c1dd-473b-9a66-2a1484f651cf', 'volume_name': 'volume-0c677b15-c1dd-473b-9a66-2a1484f651cf', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:14 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26f7ba8-597f-4cd0-b907-01e2d21ca525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:14 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26f7ba8-597f-4cd0-b907-01e2d21ca525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:14 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9299d149-1b4a-4475-9b5f-1cc6298608fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:14 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Volume 0c677b15-c1dd-473b-9a66-2a1484f651cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c677b15-c1dd-473b-9a66-2a1484f651cf', 'volume_size': 1} Sep 28 17:21:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5487e308-3002-47fa-b636-f95b0267c4f9 tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "cinder-quobyte-0bf83138-0e35-4c81-b465-b0533ec18eb2" acquired by "delete_volume" :: waited 0.082s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:14 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1d282c-12ae-458f-bbd9-1ba9b37b5203]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5487e308-3002-47fa-b636-f95b0267c4f9 tempest-TestServerVolumeAttachmentScenario-669836961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0bf83138-0e35-4c81-b465-b0533ec18eb2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:15 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0bf83138-0e35-4c81-b465-b0533ec18eb2 Sep 28 17:21:15 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:15 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5487e308-3002-47fa-b636-f95b0267c4f9 tempest-TestServerVolumeAttachmentScenario-669836961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0bf83138-0e35-4c81-b465-b0533ec18eb2" returned: 0 in 0.645s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5487e308-3002-47fa-b636-f95b0267c4f9 tempest-TestServerVolumeAttachmentScenario-669836961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0bf83138-0e35-4c81-b465-b0533ec18eb2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:15 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0bf83138-0e35-4c81-b465-b0533ec18eb2 Sep 28 17:21:15 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:15 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5487e308-3002-47fa-b636-f95b0267c4f9 tempest-TestServerVolumeAttachmentScenario-669836961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0bf83138-0e35-4c81-b465-b0533ec18eb2" returned: 0 in 0.366s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5487e308-3002-47fa-b636-f95b0267c4f9 tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "cinder-quobyte-0bf83138-0e35-4c81-b465-b0533ec18eb2" released by "delete_volume" :: held 1.119s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:16 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-5487e308-3002-47fa-b636-f95b0267c4f9 tempest-TestServerVolumeAttachmentScenario-669836961 None] Created reservations ['8bdf8f20-0645-4cd5-8f33-6775d2563f0e', '65ea71fc-48a5-42fd-aab7-2c75fef4f511', '2e26706c-08b1-4f65-bf87-c386a0d9fdad', '6ca89109-077d-4540-9f2c-42a2163e1074'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5487e308-3002-47fa-b636-f95b0267c4f9 tempest-TestServerVolumeAttachmentScenario-669836961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5487e308-3002-47fa-b636-f95b0267c4f9 tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-5487e308-3002-47fa-b636-f95b0267c4f9 tempest-TestServerVolumeAttachmentScenario-669836961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-5487e308-3002-47fa-b636-f95b0267c4f9 tempest-TestServerVolumeAttachmentScenario-669836961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5487e308-3002-47fa-b636-f95b0267c4f9 tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5487e308-3002-47fa-b636-f95b0267c4f9 tempest-TestServerVolumeAttachmentScenario-669836961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:16 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:21:16 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:16 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5487e308-3002-47fa-b636-f95b0267c4f9 tempest-TestServerVolumeAttachmentScenario-669836961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.435s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:16 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-5487e308-3002-47fa-b636-f95b0267c4f9 tempest-TestServerVolumeAttachmentScenario-669836961 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:16 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-5487e308-3002-47fa-b636-f95b0267c4f9 tempest-TestServerVolumeAttachmentScenario-669836961 None] Deleted volume successfully. Sep 28 17:21:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5487e308-3002-47fa-b636-f95b0267c4f9 tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "cinder-0bf83138-0e35-4c81-b465-b0533ec18eb2-delete_volume" released by "delete_volume" :: held 2.149s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e4b56eb4-1102-435e-a8f1-fc3d869640c3 tempest-TestServerVolumeAttachmentScenario-669836961 None] Acquiring lock "cinder-8f98e101-6a61-4981-aa69-b93ccc2a6ab2-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e4b56eb4-1102-435e-a8f1-fc3d869640c3 tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "cinder-8f98e101-6a61-4981-aa69-b93ccc2a6ab2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e4b56eb4-1102-435e-a8f1-fc3d869640c3 tempest-TestServerVolumeAttachmentScenario-669836961 None] Acquiring lock "cinder-quobyte-8f98e101-6a61-4981-aa69-b93ccc2a6ab2" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e4b56eb4-1102-435e-a8f1-fc3d869640c3 tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "cinder-quobyte-8f98e101-6a61-4981-aa69-b93ccc2a6ab2" acquired by "delete_volume" :: waited 0.026s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:17 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33a4e03-aa66-4b73-9d2a-4dd3786ea6d2]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e4b56eb4-1102-435e-a8f1-fc3d869640c3 tempest-TestServerVolumeAttachmentScenario-669836961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f98e101-6a61-4981-aa69-b93ccc2a6ab2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:17 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f98e101-6a61-4981-aa69-b93ccc2a6ab2 Sep 28 17:21:17 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:18 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e4b56eb4-1102-435e-a8f1-fc3d869640c3 tempest-TestServerVolumeAttachmentScenario-669836961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f98e101-6a61-4981-aa69-b93ccc2a6ab2" returned: 0 in 0.768s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e4b56eb4-1102-435e-a8f1-fc3d869640c3 tempest-TestServerVolumeAttachmentScenario-669836961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f98e101-6a61-4981-aa69-b93ccc2a6ab2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:18 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f98e101-6a61-4981-aa69-b93ccc2a6ab2 Sep 28 17:21:18 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:18 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e4b56eb4-1102-435e-a8f1-fc3d869640c3 tempest-TestServerVolumeAttachmentScenario-669836961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8f98e101-6a61-4981-aa69-b93ccc2a6ab2" returned: 0 in 0.620s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e4b56eb4-1102-435e-a8f1-fc3d869640c3 tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "cinder-quobyte-8f98e101-6a61-4981-aa69-b93ccc2a6ab2" released by "delete_volume" :: held 1.475s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:18 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-e4b56eb4-1102-435e-a8f1-fc3d869640c3 tempest-TestServerVolumeAttachmentScenario-669836961 None] Created reservations ['ce28f3c5-070d-4fc8-b988-750da6959e63', 'cbc5ee4f-34ed-40ea-aaf0-1f7b4eb33751', '00703546-1cd0-4423-84a7-aea1c6ebea44', '4b54b213-e7dc-4105-9963-0c757c387ab5'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e4b56eb4-1102-435e-a8f1-fc3d869640c3 tempest-TestServerVolumeAttachmentScenario-669836961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e4b56eb4-1102-435e-a8f1-fc3d869640c3 tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:18 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e4b56eb4-1102-435e-a8f1-fc3d869640c3 tempest-TestServerVolumeAttachmentScenario-669836961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:18 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e4b56eb4-1102-435e-a8f1-fc3d869640c3 tempest-TestServerVolumeAttachmentScenario-669836961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e4b56eb4-1102-435e-a8f1-fc3d869640c3 tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e4b56eb4-1102-435e-a8f1-fc3d869640c3 tempest-TestServerVolumeAttachmentScenario-669836961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:18 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:21:18 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:19 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e4b56eb4-1102-435e-a8f1-fc3d869640c3 tempest-TestServerVolumeAttachmentScenario-669836961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.423s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:19 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-e4b56eb4-1102-435e-a8f1-fc3d869640c3 tempest-TestServerVolumeAttachmentScenario-669836961 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:19 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e4b56eb4-1102-435e-a8f1-fc3d869640c3 tempest-TestServerVolumeAttachmentScenario-669836961 None] Deleted volume successfully. Sep 28 17:21:19 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e4b56eb4-1102-435e-a8f1-fc3d869640c3 tempest-TestServerVolumeAttachmentScenario-669836961 None] Lock "cinder-8f98e101-6a61-4981-aa69-b93ccc2a6ab2-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:19 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0484ea3f-70eb-440d-ac7b-09ad26985f7b" returned: 0 in 8.136s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:19 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Image conversion details: src /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350, size 1024.00 MB, duration 8.14 sec, destination /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0484ea3f-70eb-440d-ac7b-09ad26985f7b {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:21:19 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Converted 1024.00 MB image at 125.84 MB/s Sep 28 17:21:19 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0484ea3f-70eb-440d-ac7b-09ad26985f7b is being set with open permissions: ugo+rw Sep 28 17:21:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0484ea3f-70eb-440d-ac7b-09ad26985f7b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:19 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0484ea3f-70eb-440d-ac7b-09ad26985f7b Sep 28 17:21:19 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:19 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0484ea3f-70eb-440d-ac7b-09ad26985f7b" returned: 0 in 0.249s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:19 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Lock "cinder-quobyte-0484ea3f-70eb-440d-ac7b-09ad26985f7b" released by "_copy_volume_from_snapshot" :: held 9.666s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:19 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Lock "cinder-quobyte-fa2f861d-250c-4011-a9e5-f91170f0e2f0-0484ea3f-70eb-440d-ac7b-09ad26985f7b" released by "_create_volume_from_snapshot" :: held 9.752s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.774s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.213s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-947120301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c677b15-c1dd-473b-9a66-2a1484f651cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='276582b7276c49cf91fecce938d3acf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:15Z,use_quota=True,user_id='72b07fb8613641a2a8fd81c07aa95da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Creating volume 0c677b15-c1dd-473b-9a66-2a1484f651cf {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:20 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:20 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:21:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0c677b15-c1dd-473b-9a66-2a1484f651cf 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:20 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0c677b15-c1dd-473b-9a66-2a1484f651cf 1073741824 Sep 28 17:21:20 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:20 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9bac04b-8a35-47ff-ae07-d9a266316020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0484ea3f-70eb-440d-ac7b-09ad26985f7b', 'volume_size': 1, 'snapshot_id': 'fa2f861d-250c-4011-a9e5-f91170f0e2f0'}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:20 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7267c7bc-077a-47c6-89cb-fa3f9c4bb4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:20 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Volume volume-0484ea3f-70eb-440d-ac7b-09ad26985f7b (0484ea3f-70eb-440d-ac7b-09ad26985f7b): created successfully Sep 28 17:21:20 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7267c7bc-077a-47c6-89cb-fa3f9c4bb4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:20 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Flow 'volume_create_manager' (2482a495-6601-4817-aa27-df75d59ac42e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:20 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-ce6f5625-ca19-4da2-a9d0-b49b5a6d714d tempest-VolumeDependencyTests-2055984072 None] Created volume successfully. Sep 28 17:21:20 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0c677b15-c1dd-473b-9a66-2a1484f651cf 1073741824" returned: 0 in 0.501s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0c677b15-c1dd-473b-9a66-2a1484f651cf {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:20 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0c677b15-c1dd-473b-9a66-2a1484f651cf Sep 28 17:21:20 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:20 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0c677b15-c1dd-473b-9a66-2a1484f651cf" returned: 0 in 0.266s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:20 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:20 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9299d149-1b4a-4475-9b5f-1cc6298608fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c677b15-c1dd-473b-9a66-2a1484f651cf', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:20 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b506a6a-cbb6-49f7-b450-c2f449e0d8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:20 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Volume volume-0c677b15-c1dd-473b-9a66-2a1484f651cf (0c677b15-c1dd-473b-9a66-2a1484f651cf): created successfully Sep 28 17:21:20 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b506a6a-cbb6-49f7-b450-c2f449e0d8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:20 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Flow 'volume_create_manager' (e4a3e2f5-452a-4318-b2d4-11d3e0c541a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:20 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-4b5b4630-4eae-46ca-a6c6-cb693302f96c tempest-VolumesListAdminTestJSON-519811509 None] Created volume successfully. Sep 28 17:21:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e8ea959c-37b9-4e37-a781-e28fcff7c00b tempest-VolumeDependencyTests-2055984072 None] Acquiring lock "cinder-fa2f861d-250c-4011-a9e5-f91170f0e2f0-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e8ea959c-37b9-4e37-a781-e28fcff7c00b tempest-VolumeDependencyTests-2055984072 None] Lock "cinder-fa2f861d-250c-4011-a9e5-f91170f0e2f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e8ea959c-37b9-4e37-a781-e28fcff7c00b tempest-VolumeDependencyTests-2055984072 None] Acquiring lock "cinder-quobyte-5899a4ce-6da8-4ba7-bd77-b39a597e0350" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e8ea959c-37b9-4e37-a781-e28fcff7c00b tempest-VolumeDependencyTests-2055984072 None] Lock "cinder-quobyte-5899a4ce-6da8-4ba7-bd77-b39a597e0350" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e8ea959c-37b9-4e37-a781-e28fcff7c00b tempest-VolumeDependencyTests-2055984072 None] Acquiring lock "cinder-quobyte-fa2f861d-250c-4011-a9e5-f91170f0e2f0" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e8ea959c-37b9-4e37-a781-e28fcff7c00b tempest-VolumeDependencyTests-2055984072 None] Lock "cinder-quobyte-fa2f861d-250c-4011-a9e5-f91170f0e2f0" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:21 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-e8ea959c-37b9-4e37-a781-e28fcff7c00b tempest-VolumeDependencyTests-2055984072 None] Deleting offline snapshot fa2f861d-250c-4011-a9e5-f91170f0e2f0 of volume 5899a4ce-6da8-4ba7-bd77-b39a597e0350 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:21:21 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-e8ea959c-37b9-4e37-a781-e28fcff7c00b tempest-VolumeDependencyTests-2055984072 None] snapshot_file for this snap is: volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:21:21 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbc9582-cb60-47f6-890f-ed9aed891069]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e8ea959c-37b9-4e37-a781-e28fcff7c00b tempest-VolumeDependencyTests-2055984072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:21 devstack sudo[103784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0 Sep 28 17:21:21 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:21 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e8ea959c-37b9-4e37-a781-e28fcff7c00b tempest-VolumeDependencyTests-2055984072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0" returned: 0 in 0.487s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:21 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-e8ea959c-37b9-4e37-a781-e28fcff7c00b tempest-VolumeDependencyTests-2055984072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:21:21 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad5874b-fee5-4829-8fe8-f9391d438905]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e8ea959c-37b9-4e37-a781-e28fcff7c00b tempest-VolumeDependencyTests-2055984072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:21 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 Sep 28 17:21:21 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Flow 'volume_create_manager' (f1cbf1a1-0c6e-4964-af1d-ea8d67e3f295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c601a9-1dc3-4914-a058-06e0f83e6083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c601a9-1dc3-4914-a058-06e0f83e6083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2129797590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385bbc8d-bb1d-4f3b-93af-a0bdf20c820e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='276582b7276c49cf91fecce938d3acf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:22Z,use_quota=True,user_id='72b07fb8613641a2a8fd81c07aa95da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a2cd038-81d8-4ecf-93c9-2536ffa92a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a2cd038-81d8-4ecf-93c9-2536ffa92a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f54186-e88b-4f72-aea7-2cb6ece4ca00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f54186-e88b-4f72-aea7-2cb6ece4ca00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '385bbc8d-bb1d-4f3b-93af-a0bdf20c820e', 'volume_name': 'volume-385bbc8d-bb1d-4f3b-93af-a0bdf20c820e', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497c2bff-53c9-4a99-8806-ccfe6f136e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497c2bff-53c9-4a99-8806-ccfe6f136e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07515e9-a3eb-4b64-8850-1ab9e699991c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:22 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Volume 385bbc8d-bb1d-4f3b-93af-a0bdf20c820e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-385bbc8d-bb1d-4f3b-93af-a0bdf20c820e', 'volume_size': 1} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2129797590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385bbc8d-bb1d-4f3b-93af-a0bdf20c820e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='276582b7276c49cf91fecce938d3acf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:22Z,use_quota=True,user_id='72b07fb8613641a2a8fd81c07aa95da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Creating volume 385bbc8d-bb1d-4f3b-93af-a0bdf20c820e {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:22 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-385bbc8d-bb1d-4f3b-93af-a0bdf20c820e 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:22 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-385bbc8d-bb1d-4f3b-93af-a0bdf20c820e 1073741824 Sep 28 17:21:22 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:22 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e8ea959c-37b9-4e37-a781-e28fcff7c00b tempest-VolumeDependencyTests-2055984072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350" returned: 0 in 0.626s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e8ea959c-37b9-4e37-a781-e28fcff7c00b tempest-VolumeDependencyTests-2055984072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:22 devstack sudo[103799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0 Sep 28 17:21:22 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:22 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-385bbc8d-bb1d-4f3b-93af-a0bdf20c820e 1073741824" returned: 0 in 0.580s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-385bbc8d-bb1d-4f3b-93af-a0bdf20c820e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:22 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-385bbc8d-bb1d-4f3b-93af-a0bdf20c820e Sep 28 17:21:22 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:22 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e8ea959c-37b9-4e37-a781-e28fcff7c00b tempest-VolumeDependencyTests-2055984072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0" returned: 0 in 0.470s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e8ea959c-37b9-4e37-a781-e28fcff7c00b tempest-VolumeDependencyTests-2055984072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:22 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0 Sep 28 17:21:22 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:23 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-385bbc8d-bb1d-4f3b-93af-a0bdf20c820e" returned: 0 in 0.328s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:23 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:23 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07515e9-a3eb-4b64-8850-1ab9e699991c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-385bbc8d-bb1d-4f3b-93af-a0bdf20c820e', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:23 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a057c6c-2be8-4ff0-8ef0-6b031ffa74fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:23 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Volume volume-385bbc8d-bb1d-4f3b-93af-a0bdf20c820e (385bbc8d-bb1d-4f3b-93af-a0bdf20c820e): created successfully Sep 28 17:21:23 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a057c6c-2be8-4ff0-8ef0-6b031ffa74fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:23 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Flow 'volume_create_manager' (f1cbf1a1-0c6e-4964-af1d-ea8d67e3f295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:23 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e57eb0b4-73f6-4494-a229-0bfc64011601 tempest-VolumesListAdminTestJSON-519811509 None] Created volume successfully. Sep 28 17:21:23 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e8ea959c-37b9-4e37-a781-e28fcff7c00b tempest-VolumeDependencyTests-2055984072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350.fa2f861d-250c-4011-a9e5-f91170f0e2f0" returned: 0 in 0.286s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e8ea959c-37b9-4e37-a781-e28fcff7c00b tempest-VolumeDependencyTests-2055984072 None] Lock "cinder-quobyte-fa2f861d-250c-4011-a9e5-f91170f0e2f0" released by "_delete_snapshot" :: held 2.047s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e8ea959c-37b9-4e37-a781-e28fcff7c00b tempest-VolumeDependencyTests-2055984072 None] Lock "cinder-quobyte-5899a4ce-6da8-4ba7-bd77-b39a597e0350" released by "delete_snapshot" :: held 2.080s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:23 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-e8ea959c-37b9-4e37-a781-e28fcff7c00b tempest-VolumeDependencyTests-2055984072 None] Created reservations ['935a77b7-8404-4ab8-baa8-32913ce2f05e', 'c636ce72-23be-4812-ba44-f84f82c4a21f', 'a49cc045-08cd-4f72-98c0-6f70797d4f75', '588e9a56-fa0b-420d-b623-5912e6b756ec'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:23 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e8ea959c-37b9-4e37-a781-e28fcff7c00b tempest-VolumeDependencyTests-2055984072 None] Delete snapshot completed successfully. Sep 28 17:21:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e8ea959c-37b9-4e37-a781-e28fcff7c00b tempest-VolumeDependencyTests-2055984072 None] Lock "cinder-fa2f861d-250c-4011-a9e5-f91170f0e2f0-delete_snapshot" released by "delete_snapshot" :: held 2.256s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-018bf2d5-8e4f-4928-b13d-3867809bbfd9 tempest-VolumeDependencyTests-2055984072 None] Acquiring lock "cinder-5899a4ce-6da8-4ba7-bd77-b39a597e0350-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-018bf2d5-8e4f-4928-b13d-3867809bbfd9 tempest-VolumeDependencyTests-2055984072 None] Lock "cinder-5899a4ce-6da8-4ba7-bd77-b39a597e0350-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-018bf2d5-8e4f-4928-b13d-3867809bbfd9 tempest-VolumeDependencyTests-2055984072 None] Acquiring lock "cinder-quobyte-5899a4ce-6da8-4ba7-bd77-b39a597e0350" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-018bf2d5-8e4f-4928-b13d-3867809bbfd9 tempest-VolumeDependencyTests-2055984072 None] Lock "cinder-quobyte-5899a4ce-6da8-4ba7-bd77-b39a597e0350" acquired by "delete_volume" :: waited 0.052s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b067880-dbce-4ba9-bcf7-756eac9b95bb]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-018bf2d5-8e4f-4928-b13d-3867809bbfd9 tempest-VolumeDependencyTests-2055984072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Flow 'volume_create_manager' (c10f7176-5911-4feb-80b3-6cbc90f5f73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:24 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 Sep 28 17:21:24 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5e7cbb-c63b-42f2-8f26-38ca3896d3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5e7cbb-c63b-42f2-8f26-38ca3896d3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1583393197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d2465be-6b89-462c-ab0c-244d4425a0a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='276582b7276c49cf91fecce938d3acf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:25Z,use_quota=True,user_id='72b07fb8613641a2a8fd81c07aa95da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ecc23cf-cf07-4af9-9f5b-bbc5865d9daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ecc23cf-cf07-4af9-9f5b-bbc5865d9daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4de9a1c-9b1b-4734-9921-72d7bb3f37f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4de9a1c-9b1b-4734-9921-72d7bb3f37f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d2465be-6b89-462c-ab0c-244d4425a0a6', 'volume_name': 'volume-8d2465be-6b89-462c-ab0c-244d4425a0a6', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a616a449-d4cd-44be-b250-48c9ab2ffb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a616a449-d4cd-44be-b250-48c9ab2ffb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c51cb8-dce5-4521-b859-0888943808c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:24 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Volume 8d2465be-6b89-462c-ab0c-244d4425a0a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d2465be-6b89-462c-ab0c-244d4425a0a6', 'volume_size': 1} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1583393197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d2465be-6b89-462c-ab0c-244d4425a0a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='276582b7276c49cf91fecce938d3acf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:25Z,use_quota=True,user_id='72b07fb8613641a2a8fd81c07aa95da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Creating volume 8d2465be-6b89-462c-ab0c-244d4425a0a6 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:24 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:21:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8d2465be-6b89-462c-ab0c-244d4425a0a6 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:24 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8d2465be-6b89-462c-ab0c-244d4425a0a6 1073741824 Sep 28 17:21:24 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:25 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-018bf2d5-8e4f-4928-b13d-3867809bbfd9 tempest-VolumeDependencyTests-2055984072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350" returned: 0 in 0.532s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-018bf2d5-8e4f-4928-b13d-3867809bbfd9 tempest-VolumeDependencyTests-2055984072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:25 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350 Sep 28 17:21:25 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:25 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-018bf2d5-8e4f-4928-b13d-3867809bbfd9 tempest-VolumeDependencyTests-2055984072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5899a4ce-6da8-4ba7-bd77-b39a597e0350" returned: 0 in 0.324s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:25 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:25 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-018bf2d5-8e4f-4928-b13d-3867809bbfd9 tempest-VolumeDependencyTests-2055984072 None] Lock "cinder-quobyte-5899a4ce-6da8-4ba7-bd77-b39a597e0350" released by "delete_volume" :: held 0.961s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8d2465be-6b89-462c-ab0c-244d4425a0a6 1073741824" returned: 0 in 0.627s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8d2465be-6b89-462c-ab0c-244d4425a0a6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:25 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8d2465be-6b89-462c-ab0c-244d4425a0a6 Sep 28 17:21:25 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:25 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-018bf2d5-8e4f-4928-b13d-3867809bbfd9 tempest-VolumeDependencyTests-2055984072 None] Created reservations ['93be80e1-fc11-4603-a9a4-62267b9728b8', '555856ec-b59b-4782-b5e2-552517a8305e', 'ee4ea7ca-3822-40fd-b508-7068cb511714', '1ff27b04-76a1-4460-9a70-4c3b2405d82e'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-018bf2d5-8e4f-4928-b13d-3867809bbfd9 tempest-VolumeDependencyTests-2055984072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-018bf2d5-8e4f-4928-b13d-3867809bbfd9 tempest-VolumeDependencyTests-2055984072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:25 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-018bf2d5-8e4f-4928-b13d-3867809bbfd9 tempest-VolumeDependencyTests-2055984072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:25 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-018bf2d5-8e4f-4928-b13d-3867809bbfd9 tempest-VolumeDependencyTests-2055984072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-018bf2d5-8e4f-4928-b13d-3867809bbfd9 tempest-VolumeDependencyTests-2055984072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-018bf2d5-8e4f-4928-b13d-3867809bbfd9 tempest-VolumeDependencyTests-2055984072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:25 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:21:25 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:25 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8d2465be-6b89-462c-ab0c-244d4425a0a6" returned: 0 in 0.366s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:25 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c51cb8-dce5-4521-b859-0888943808c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d2465be-6b89-462c-ab0c-244d4425a0a6', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342364b3-521f-4c60-9e4d-e991ebeb98a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:25 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Volume volume-8d2465be-6b89-462c-ab0c-244d4425a0a6 (8d2465be-6b89-462c-ab0c-244d4425a0a6): created successfully Sep 28 17:21:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342364b3-521f-4c60-9e4d-e991ebeb98a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Flow 'volume_create_manager' (c10f7176-5911-4feb-80b3-6cbc90f5f73d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:26 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-55c754f4-3c79-4ece-b88a-ccb61b80f868 tempest-VolumesListAdminTestJSON-519811509 None] Created volume successfully. Sep 28 17:21:26 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-018bf2d5-8e4f-4928-b13d-3867809bbfd9 tempest-VolumeDependencyTests-2055984072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.313s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:26 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-018bf2d5-8e4f-4928-b13d-3867809bbfd9 tempest-VolumeDependencyTests-2055984072 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:26 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-018bf2d5-8e4f-4928-b13d-3867809bbfd9 tempest-VolumeDependencyTests-2055984072 None] Deleted volume successfully. Sep 28 17:21:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-018bf2d5-8e4f-4928-b13d-3867809bbfd9 tempest-VolumeDependencyTests-2055984072 None] Lock "cinder-5899a4ce-6da8-4ba7-bd77-b39a597e0350-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0c7c2684-cbce-4fa5-a94f-103197fa681b tempest-VolumeDependencyTests-2055984072 None] Acquiring lock "cinder-0484ea3f-70eb-440d-ac7b-09ad26985f7b-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0c7c2684-cbce-4fa5-a94f-103197fa681b tempest-VolumeDependencyTests-2055984072 None] Lock "cinder-0484ea3f-70eb-440d-ac7b-09ad26985f7b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0c7c2684-cbce-4fa5-a94f-103197fa681b tempest-VolumeDependencyTests-2055984072 None] Acquiring lock "cinder-quobyte-0484ea3f-70eb-440d-ac7b-09ad26985f7b" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0c7c2684-cbce-4fa5-a94f-103197fa681b tempest-VolumeDependencyTests-2055984072 None] Lock "cinder-quobyte-0484ea3f-70eb-440d-ac7b-09ad26985f7b" acquired by "delete_volume" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:26 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b94610-7b6f-4c28-8bce-08fe9aa50d1b]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0c7c2684-cbce-4fa5-a94f-103197fa681b tempest-VolumeDependencyTests-2055984072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0484ea3f-70eb-440d-ac7b-09ad26985f7b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:27 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0484ea3f-70eb-440d-ac7b-09ad26985f7b Sep 28 17:21:27 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:27 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0c7c2684-cbce-4fa5-a94f-103197fa681b tempest-VolumeDependencyTests-2055984072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0484ea3f-70eb-440d-ac7b-09ad26985f7b" returned: 0 in 0.453s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0c7c2684-cbce-4fa5-a94f-103197fa681b tempest-VolumeDependencyTests-2055984072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0484ea3f-70eb-440d-ac7b-09ad26985f7b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:27 devstack sudo[103838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0484ea3f-70eb-440d-ac7b-09ad26985f7b Sep 28 17:21:27 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:27 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0c7c2684-cbce-4fa5-a94f-103197fa681b tempest-VolumeDependencyTests-2055984072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0484ea3f-70eb-440d-ac7b-09ad26985f7b" returned: 0 in 0.341s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:27 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0c7c2684-cbce-4fa5-a94f-103197fa681b tempest-VolumeDependencyTests-2055984072 None] Lock "cinder-quobyte-0484ea3f-70eb-440d-ac7b-09ad26985f7b" released by "delete_volume" :: held 0.879s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:27 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-0c7c2684-cbce-4fa5-a94f-103197fa681b tempest-VolumeDependencyTests-2055984072 None] Created reservations ['27c82d56-7534-4f26-8d1d-23750273d24f', 'f60eeb98-6aae-4577-99a3-eb0174470ead', '223b3105-d6c0-462c-86d1-96838a162509', '96717920-b398-4d99-826a-e176bb5132fe'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Flow 'volume_create_manager' (fdb1b831-cbea-4dc7-aaab-c13be0c8c475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ad48ff-64a4-4a23-9f5a-514e29aa8781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ad48ff-64a4-4a23-9f5a-514e29aa8781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb78c92f-7f95-4768-a37e-610e317097e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be48642eedb243f3bc3e85f5baac54c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:28Z,use_quota=True,user_id='9f26e1e2f12140f7842b04aa5f2e50eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e834161-66f0-495c-b6f2-00f1bfb980e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e834161-66f0-495c-b6f2-00f1bfb980e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea5dd52-a27a-4301-b088-12a70e7d7971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea5dd52-a27a-4301-b088-12a70e7d7971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb78c92f-7f95-4768-a37e-610e317097e7', 'volume_name': 'volume-eb78c92f-7f95-4768-a37e-610e317097e7', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8fbb27-79a9-47e5-903d-82e726e3b6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8fbb27-79a9-47e5-903d-82e726e3b6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64da976a-43c2-47a0-9a5a-79c1eb714a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:28 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Volume eb78c92f-7f95-4768-a37e-610e317097e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb78c92f-7f95-4768-a37e-610e317097e7', 'volume_size': 1} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb78c92f-7f95-4768-a37e-610e317097e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be48642eedb243f3bc3e85f5baac54c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:28Z,use_quota=True,user_id='9f26e1e2f12140f7842b04aa5f2e50eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Creating volume eb78c92f-7f95-4768-a37e-610e317097e7 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:28 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eb78c92f-7f95-4768-a37e-610e317097e7 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:28 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eb78c92f-7f95-4768-a37e-610e317097e7 1073741824 Sep 28 17:21:28 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0c7c2684-cbce-4fa5-a94f-103197fa681b tempest-VolumeDependencyTests-2055984072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0c7c2684-cbce-4fa5-a94f-103197fa681b tempest-VolumeDependencyTests-2055984072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0c7c2684-cbce-4fa5-a94f-103197fa681b tempest-VolumeDependencyTests-2055984072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0c7c2684-cbce-4fa5-a94f-103197fa681b tempest-VolumeDependencyTests-2055984072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0c7c2684-cbce-4fa5-a94f-103197fa681b tempest-VolumeDependencyTests-2055984072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0c7c2684-cbce-4fa5-a94f-103197fa681b tempest-VolumeDependencyTests-2055984072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:28 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:21:28 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:28 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0c7c2684-cbce-4fa5-a94f-103197fa681b tempest-VolumeDependencyTests-2055984072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.340s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-0c7c2684-cbce-4fa5-a94f-103197fa681b tempest-VolumeDependencyTests-2055984072 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:28 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-0c7c2684-cbce-4fa5-a94f-103197fa681b tempest-VolumeDependencyTests-2055984072 None] Deleted volume successfully. Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0c7c2684-cbce-4fa5-a94f-103197fa681b tempest-VolumeDependencyTests-2055984072 None] Lock "cinder-0484ea3f-70eb-440d-ac7b-09ad26985f7b-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:28 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eb78c92f-7f95-4768-a37e-610e317097e7 1073741824" returned: 0 in 0.567s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eb78c92f-7f95-4768-a37e-610e317097e7 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:28 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eb78c92f-7f95-4768-a37e-610e317097e7 Sep 28 17:21:28 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:28 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eb78c92f-7f95-4768-a37e-610e317097e7" returned: 0 in 0.259s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64da976a-43c2-47a0-9a5a-79c1eb714a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb78c92f-7f95-4768-a37e-610e317097e7', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3475b59-bbb6-4b9d-a33c-c82ffb1bdeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:29 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Volume volume-eb78c92f-7f95-4768-a37e-610e317097e7 (eb78c92f-7f95-4768-a37e-610e317097e7): created successfully Sep 28 17:21:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3475b59-bbb6-4b9d-a33c-c82ffb1bdeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Flow 'volume_create_manager' (fdb1b831-cbea-4dc7-aaab-c13be0c8c475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:29 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-3b822d4f-5d77-44d3-a9d9-1a947c8ec07c tempest-VolumesListAdminTestJSON-808819410 None] Created volume successfully. Sep 28 17:21:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-19ba4781-ef2b-4266-b0f9-17e0bfe60a70 tempest-VolumesListAdminTestJSON-808819410 None] Acquiring lock "cinder-eb78c92f-7f95-4768-a37e-610e317097e7-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-19ba4781-ef2b-4266-b0f9-17e0bfe60a70 tempest-VolumesListAdminTestJSON-808819410 None] Lock "cinder-eb78c92f-7f95-4768-a37e-610e317097e7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-19ba4781-ef2b-4266-b0f9-17e0bfe60a70 tempest-VolumesListAdminTestJSON-808819410 None] Acquiring lock "cinder-quobyte-eb78c92f-7f95-4768-a37e-610e317097e7" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-19ba4781-ef2b-4266-b0f9-17e0bfe60a70 tempest-VolumesListAdminTestJSON-808819410 None] Lock "cinder-quobyte-eb78c92f-7f95-4768-a37e-610e317097e7" acquired by "delete_volume" :: waited 0.021s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:30 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b7f423-71c6-4e41-be50-54ceb8445353]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19ba4781-ef2b-4266-b0f9-17e0bfe60a70 tempest-VolumesListAdminTestJSON-808819410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eb78c92f-7f95-4768-a37e-610e317097e7 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-085e4bc7-9ad6-4546-b741-9c2820184f09 tempest-VolumesListAdminTestJSON-519811509 None] Acquiring lock "cinder-8d2465be-6b89-462c-ab0c-244d4425a0a6-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-085e4bc7-9ad6-4546-b741-9c2820184f09 tempest-VolumesListAdminTestJSON-519811509 None] Lock "cinder-8d2465be-6b89-462c-ab0c-244d4425a0a6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-085e4bc7-9ad6-4546-b741-9c2820184f09 tempest-VolumesListAdminTestJSON-519811509 None] Acquiring lock "cinder-quobyte-8d2465be-6b89-462c-ab0c-244d4425a0a6" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-085e4bc7-9ad6-4546-b741-9c2820184f09 tempest-VolumesListAdminTestJSON-519811509 None] Lock "cinder-quobyte-8d2465be-6b89-462c-ab0c-244d4425a0a6" acquired by "delete_volume" :: waited 0.027s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:30 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eb78c92f-7f95-4768-a37e-610e317097e7 Sep 28 17:21:30 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:30 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9419f4-2bf7-4d6b-a2f3-518d1b8f34f1]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-085e4bc7-9ad6-4546-b741-9c2820184f09 tempest-VolumesListAdminTestJSON-519811509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8d2465be-6b89-462c-ab0c-244d4425a0a6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:30 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8d2465be-6b89-462c-ab0c-244d4425a0a6 Sep 28 17:21:30 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:30 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19ba4781-ef2b-4266-b0f9-17e0bfe60a70 tempest-VolumesListAdminTestJSON-808819410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eb78c92f-7f95-4768-a37e-610e317097e7" returned: 0 in 0.640s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19ba4781-ef2b-4266-b0f9-17e0bfe60a70 tempest-VolumesListAdminTestJSON-808819410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eb78c92f-7f95-4768-a37e-610e317097e7 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:31 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eb78c92f-7f95-4768-a37e-610e317097e7 Sep 28 17:21:31 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:31 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-085e4bc7-9ad6-4546-b741-9c2820184f09 tempest-VolumesListAdminTestJSON-519811509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8d2465be-6b89-462c-ab0c-244d4425a0a6" returned: 0 in 0.576s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-085e4bc7-9ad6-4546-b741-9c2820184f09 tempest-VolumesListAdminTestJSON-519811509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8d2465be-6b89-462c-ab0c-244d4425a0a6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:31 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8d2465be-6b89-462c-ab0c-244d4425a0a6 Sep 28 17:21:31 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:31 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19ba4781-ef2b-4266-b0f9-17e0bfe60a70 tempest-VolumesListAdminTestJSON-808819410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eb78c92f-7f95-4768-a37e-610e317097e7" returned: 0 in 0.360s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-19ba4781-ef2b-4266-b0f9-17e0bfe60a70 tempest-VolumesListAdminTestJSON-808819410 None] Lock "cinder-quobyte-eb78c92f-7f95-4768-a37e-610e317097e7" released by "delete_volume" :: held 1.080s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:31 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-19ba4781-ef2b-4266-b0f9-17e0bfe60a70 tempest-VolumesListAdminTestJSON-808819410 None] Created reservations ['0b69ff7d-7a24-4bfd-b049-d67c56b0b6dc', 'c5cfd20c-3725-46db-97be-92480920b689', '21442000-ac08-4b3d-ad5c-4eb927ae156c', '8df5e42d-b446-4491-879e-3b30a81da4a5'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:31 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-085e4bc7-9ad6-4546-b741-9c2820184f09 tempest-VolumesListAdminTestJSON-519811509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8d2465be-6b89-462c-ab0c-244d4425a0a6" returned: 0 in 0.383s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-19ba4781-ef2b-4266-b0f9-17e0bfe60a70 tempest-VolumesListAdminTestJSON-808819410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-19ba4781-ef2b-4266-b0f9-17e0bfe60a70 tempest-VolumesListAdminTestJSON-808819410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:31 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-19ba4781-ef2b-4266-b0f9-17e0bfe60a70 tempest-VolumesListAdminTestJSON-808819410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:31 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-19ba4781-ef2b-4266-b0f9-17e0bfe60a70 tempest-VolumesListAdminTestJSON-808819410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-19ba4781-ef2b-4266-b0f9-17e0bfe60a70 tempest-VolumesListAdminTestJSON-808819410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19ba4781-ef2b-4266-b0f9-17e0bfe60a70 tempest-VolumesListAdminTestJSON-808819410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-085e4bc7-9ad6-4546-b741-9c2820184f09 tempest-VolumesListAdminTestJSON-519811509 None] Lock "cinder-quobyte-8d2465be-6b89-462c-ab0c-244d4425a0a6" released by "delete_volume" :: held 1.069s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:31 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:21:31 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:31 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-085e4bc7-9ad6-4546-b741-9c2820184f09 tempest-VolumesListAdminTestJSON-519811509 None] Created reservations ['72c3821a-0c8a-4049-9f66-66f2cf9ce53a', 'c7661216-9840-4a79-92a4-4a56c7d1cf3a', '4ecdbc13-b998-4c56-be09-bf9f2035803a', 'efc1ee7a-5cff-4004-a7f4-09d09e41c829'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-085e4bc7-9ad6-4546-b741-9c2820184f09 tempest-VolumesListAdminTestJSON-519811509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-085e4bc7-9ad6-4546-b741-9c2820184f09 tempest-VolumesListAdminTestJSON-519811509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:31 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-085e4bc7-9ad6-4546-b741-9c2820184f09 tempest-VolumesListAdminTestJSON-519811509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:31 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-085e4bc7-9ad6-4546-b741-9c2820184f09 tempest-VolumesListAdminTestJSON-519811509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-085e4bc7-9ad6-4546-b741-9c2820184f09 tempest-VolumesListAdminTestJSON-519811509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-085e4bc7-9ad6-4546-b741-9c2820184f09 tempest-VolumesListAdminTestJSON-519811509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:31 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:21:31 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:32 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19ba4781-ef2b-4266-b0f9-17e0bfe60a70 tempest-VolumesListAdminTestJSON-808819410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.447s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:32 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-19ba4781-ef2b-4266-b0f9-17e0bfe60a70 tempest-VolumesListAdminTestJSON-808819410 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:32 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-19ba4781-ef2b-4266-b0f9-17e0bfe60a70 tempest-VolumesListAdminTestJSON-808819410 None] Deleted volume successfully. Sep 28 17:21:32 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-19ba4781-ef2b-4266-b0f9-17e0bfe60a70 tempest-VolumesListAdminTestJSON-808819410 None] Lock "cinder-eb78c92f-7f95-4768-a37e-610e317097e7-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:32 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-085e4bc7-9ad6-4546-b741-9c2820184f09 tempest-VolumesListAdminTestJSON-519811509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.419s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:32 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-085e4bc7-9ad6-4546-b741-9c2820184f09 tempest-VolumesListAdminTestJSON-519811509 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:32 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-085e4bc7-9ad6-4546-b741-9c2820184f09 tempest-VolumesListAdminTestJSON-519811509 None] Deleted volume successfully. Sep 28 17:21:32 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-085e4bc7-9ad6-4546-b741-9c2820184f09 tempest-VolumesListAdminTestJSON-519811509 None] Lock "cinder-8d2465be-6b89-462c-ab0c-244d4425a0a6-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:32 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d5d7c5b8-caa6-47ae-876e-5a7cfb2052a6 tempest-VolumesListAdminTestJSON-519811509 None] Acquiring lock "cinder-385bbc8d-bb1d-4f3b-93af-a0bdf20c820e-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:32 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d5d7c5b8-caa6-47ae-876e-5a7cfb2052a6 tempest-VolumesListAdminTestJSON-519811509 None] Lock "cinder-385bbc8d-bb1d-4f3b-93af-a0bdf20c820e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:32 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d5d7c5b8-caa6-47ae-876e-5a7cfb2052a6 tempest-VolumesListAdminTestJSON-519811509 None] Acquiring lock "cinder-quobyte-385bbc8d-bb1d-4f3b-93af-a0bdf20c820e" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:32 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d5d7c5b8-caa6-47ae-876e-5a7cfb2052a6 tempest-VolumesListAdminTestJSON-519811509 None] Lock "cinder-quobyte-385bbc8d-bb1d-4f3b-93af-a0bdf20c820e" acquired by "delete_volume" :: waited 0.032s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:33 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae29349-4ad0-4ed1-80da-35a4451a3d63]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d5d7c5b8-caa6-47ae-876e-5a7cfb2052a6 tempest-VolumesListAdminTestJSON-519811509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-385bbc8d-bb1d-4f3b-93af-a0bdf20c820e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:33 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-385bbc8d-bb1d-4f3b-93af-a0bdf20c820e Sep 28 17:21:33 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:33 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d5d7c5b8-caa6-47ae-876e-5a7cfb2052a6 tempest-VolumesListAdminTestJSON-519811509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-385bbc8d-bb1d-4f3b-93af-a0bdf20c820e" returned: 0 in 0.461s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d5d7c5b8-caa6-47ae-876e-5a7cfb2052a6 tempest-VolumesListAdminTestJSON-519811509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-385bbc8d-bb1d-4f3b-93af-a0bdf20c820e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:33 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-385bbc8d-bb1d-4f3b-93af-a0bdf20c820e Sep 28 17:21:33 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:33 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d5d7c5b8-caa6-47ae-876e-5a7cfb2052a6 tempest-VolumesListAdminTestJSON-519811509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-385bbc8d-bb1d-4f3b-93af-a0bdf20c820e" returned: 0 in 0.352s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:33 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d5d7c5b8-caa6-47ae-876e-5a7cfb2052a6 tempest-VolumesListAdminTestJSON-519811509 None] Lock "cinder-quobyte-385bbc8d-bb1d-4f3b-93af-a0bdf20c820e" released by "delete_volume" :: held 0.887s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:33 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-d5d7c5b8-caa6-47ae-876e-5a7cfb2052a6 tempest-VolumesListAdminTestJSON-519811509 None] Created reservations ['2d1d70cc-4c3d-4fcd-b778-e891eaa4d14a', 'e6efd384-a0b0-497e-bf07-d41378f12c3d', '5784953c-ca64-41f8-90ec-99d7d31ea640', '01d2662a-518d-4b2e-8fbf-80db828101df'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d5d7c5b8-caa6-47ae-876e-5a7cfb2052a6 tempest-VolumesListAdminTestJSON-519811509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d5d7c5b8-caa6-47ae-876e-5a7cfb2052a6 tempest-VolumesListAdminTestJSON-519811509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d5d7c5b8-caa6-47ae-876e-5a7cfb2052a6 tempest-VolumesListAdminTestJSON-519811509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d5d7c5b8-caa6-47ae-876e-5a7cfb2052a6 tempest-VolumesListAdminTestJSON-519811509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d5d7c5b8-caa6-47ae-876e-5a7cfb2052a6 tempest-VolumesListAdminTestJSON-519811509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d5d7c5b8-caa6-47ae-876e-5a7cfb2052a6 tempest-VolumesListAdminTestJSON-519811509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:34 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:21:34 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:34 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-57e8b131-851b-4dba-9c79-4fd1a9e5715a tempest-VolumesListAdminTestJSON-519811509 None] Acquiring lock "cinder-0c677b15-c1dd-473b-9a66-2a1484f651cf-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:34 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-57e8b131-851b-4dba-9c79-4fd1a9e5715a tempest-VolumesListAdminTestJSON-519811509 None] Lock "cinder-0c677b15-c1dd-473b-9a66-2a1484f651cf-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:34 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-57e8b131-851b-4dba-9c79-4fd1a9e5715a tempest-VolumesListAdminTestJSON-519811509 None] Acquiring lock "cinder-quobyte-0c677b15-c1dd-473b-9a66-2a1484f651cf" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:34 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-57e8b131-851b-4dba-9c79-4fd1a9e5715a tempest-VolumesListAdminTestJSON-519811509 None] Lock "cinder-quobyte-0c677b15-c1dd-473b-9a66-2a1484f651cf" acquired by "delete_volume" :: waited 0.027s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:34 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[734b1485-e1cd-4335-8e67-a2f88e3d8d01]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57e8b131-851b-4dba-9c79-4fd1a9e5715a tempest-VolumesListAdminTestJSON-519811509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0c677b15-c1dd-473b-9a66-2a1484f651cf {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:34 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0c677b15-c1dd-473b-9a66-2a1484f651cf Sep 28 17:21:34 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:34 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d5d7c5b8-caa6-47ae-876e-5a7cfb2052a6 tempest-VolumesListAdminTestJSON-519811509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.485s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:34 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-d5d7c5b8-caa6-47ae-876e-5a7cfb2052a6 tempest-VolumesListAdminTestJSON-519811509 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:34 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d5d7c5b8-caa6-47ae-876e-5a7cfb2052a6 tempest-VolumesListAdminTestJSON-519811509 None] Deleted volume successfully. Sep 28 17:21:34 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d5d7c5b8-caa6-47ae-876e-5a7cfb2052a6 tempest-VolumesListAdminTestJSON-519811509 None] Lock "cinder-385bbc8d-bb1d-4f3b-93af-a0bdf20c820e-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:34 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57e8b131-851b-4dba-9c79-4fd1a9e5715a tempest-VolumesListAdminTestJSON-519811509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0c677b15-c1dd-473b-9a66-2a1484f651cf" returned: 0 in 0.535s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57e8b131-851b-4dba-9c79-4fd1a9e5715a tempest-VolumesListAdminTestJSON-519811509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0c677b15-c1dd-473b-9a66-2a1484f651cf {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:34 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0c677b15-c1dd-473b-9a66-2a1484f651cf Sep 28 17:21:34 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:35 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57e8b131-851b-4dba-9c79-4fd1a9e5715a tempest-VolumesListAdminTestJSON-519811509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0c677b15-c1dd-473b-9a66-2a1484f651cf" returned: 0 in 0.337s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:35 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-57e8b131-851b-4dba-9c79-4fd1a9e5715a tempest-VolumesListAdminTestJSON-519811509 None] Lock "cinder-quobyte-0c677b15-c1dd-473b-9a66-2a1484f651cf" released by "delete_volume" :: held 0.961s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:35 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-57e8b131-851b-4dba-9c79-4fd1a9e5715a tempest-VolumesListAdminTestJSON-519811509 None] Created reservations ['cf1ff871-b230-45e1-a1d0-5503767ef8f5', '1e0bb1ac-69ed-4a20-9f21-49380e006fea', 'd3acb255-518d-4ba3-868d-ea390383578c', '283dc6e6-6bf2-422d-90b8-b0987526b4c5'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-57e8b131-851b-4dba-9c79-4fd1a9e5715a tempest-VolumesListAdminTestJSON-519811509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-57e8b131-851b-4dba-9c79-4fd1a9e5715a tempest-VolumesListAdminTestJSON-519811509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-57e8b131-851b-4dba-9c79-4fd1a9e5715a tempest-VolumesListAdminTestJSON-519811509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-57e8b131-851b-4dba-9c79-4fd1a9e5715a tempest-VolumesListAdminTestJSON-519811509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-57e8b131-851b-4dba-9c79-4fd1a9e5715a tempest-VolumesListAdminTestJSON-519811509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57e8b131-851b-4dba-9c79-4fd1a9e5715a tempest-VolumesListAdminTestJSON-519811509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:35 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:21:35 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:35 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-57e8b131-851b-4dba-9c79-4fd1a9e5715a tempest-VolumesListAdminTestJSON-519811509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.351s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:35 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-57e8b131-851b-4dba-9c79-4fd1a9e5715a tempest-VolumesListAdminTestJSON-519811509 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:35 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-57e8b131-851b-4dba-9c79-4fd1a9e5715a tempest-VolumesListAdminTestJSON-519811509 None] Deleted volume successfully. Sep 28 17:21:35 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-57e8b131-851b-4dba-9c79-4fd1a9e5715a tempest-VolumesListAdminTestJSON-519811509 None] Lock "cinder-0c677b15-c1dd-473b-9a66-2a1484f651cf-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Flow 'volume_create_manager' (3046b691-db2e-4305-a7f7-a09a039d2b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda1b6a1-67e9-42ca-a291-e7cb6e3c1d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda1b6a1-67e9-42ca-a291-e7cb6e3c1d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-638428818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d783e9-8016-404f-9de0-227180ca49d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549f4dbef80140a4bc6679b7975a8ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:45Z,use_quota=True,user_id='56cd857a91ad448c8f88d823a84ecf68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf31ddd-cc68-44e7-824c-43dcacfa489c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf31ddd-cc68-44e7-824c-43dcacfa489c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bce7949-ea87-40dc-9a50-dc97aa7f1284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bce7949-ea87-40dc-9a50-dc97aa7f1284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32d783e9-8016-404f-9de0-227180ca49d5', 'volume_name': 'volume-32d783e9-8016-404f-9de0-227180ca49d5', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfee5074-5732-4937-806c-022f73645f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfee5074-5732-4937-806c-022f73645f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4675478-b611-4cbf-9ee3-e71070b9d068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:45 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Volume 32d783e9-8016-404f-9de0-227180ca49d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32d783e9-8016-404f-9de0-227180ca49d5', 'volume_size': 1} Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-638428818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d783e9-8016-404f-9de0-227180ca49d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549f4dbef80140a4bc6679b7975a8ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:45Z,use_quota=True,user_id='56cd857a91ad448c8f88d823a84ecf68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Creating volume 32d783e9-8016-404f-9de0-227180ca49d5 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:45 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:45 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5 1073741824 Sep 28 17:21:45 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:45 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5 1073741824" returned: 0 in 0.621s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:45 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5 Sep 28 17:21:45 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:46 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5" returned: 0 in 0.327s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4675478-b611-4cbf-9ee3-e71070b9d068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32d783e9-8016-404f-9de0-227180ca49d5', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0025c49b-fe98-4b7d-9846-1500afa922af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:46 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Volume volume-32d783e9-8016-404f-9de0-227180ca49d5 (32d783e9-8016-404f-9de0-227180ca49d5): created successfully Sep 28 17:21:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0025c49b-fe98-4b7d-9846-1500afa922af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Flow 'volume_create_manager' (3046b691-db2e-4305-a7f7-a09a039d2b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:46 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-b40076ae-8e14-4eb4-8772-9a2cf69bcd12 tempest-VolumesDeleteCascade-2022122508 None] Created volume successfully. Sep 28 17:21:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3c2e0406-27ea-414b-aadf-4e174dd1b587 tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3c2e0406-27ea-414b-aadf-4e174dd1b587 tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-3c2e0406-27ea-414b-aadf-4e174dd1b587 tempest-VolumesDeleteCascade-2022122508 None] Creating offline snapshot f783780e-a5e8-4f39-a37a-0148fb0d475a of volume 32d783e9-8016-404f-9de0-227180ca49d5 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:21:47 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d79e7a6-95f4-4b8d-bf9c-29d9c4ec2a6b]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3c2e0406-27ea-414b-aadf-4e174dd1b587 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:47 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5 Sep 28 17:21:47 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:48 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3c2e0406-27ea-414b-aadf-4e174dd1b587 tempest-VolumesDeleteCascade-2022122508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5" returned: 0 in 0.557s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3c2e0406-27ea-414b-aadf-4e174dd1b587 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:48 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a 1G Sep 28 17:21:48 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:48 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3c2e0406-27ea-414b-aadf-4e174dd1b587 tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a 1G" returned: 0 in 0.714s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3c2e0406-27ea-414b-aadf-4e174dd1b587 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32d783e9-8016-404f-9de0-227180ca49d5 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:48 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32d783e9-8016-404f-9de0-227180ca49d5 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a Sep 28 17:21:48 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:49 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3c2e0406-27ea-414b-aadf-4e174dd1b587 tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32d783e9-8016-404f-9de0-227180ca49d5 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a" returned: 0 in 0.433s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:49 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-3c2e0406-27ea-414b-aadf-4e174dd1b587 tempest-VolumesDeleteCascade-2022122508 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a is being set with open permissions: ugo+rw Sep 28 17:21:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3c2e0406-27ea-414b-aadf-4e174dd1b587 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:49 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a Sep 28 17:21:49 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:49 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3c2e0406-27ea-414b-aadf-4e174dd1b587 tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a" returned: 0 in 0.297s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3c2e0406-27ea-414b-aadf-4e174dd1b587 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:49 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.info Sep 28 17:21:49 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:49 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3c2e0406-27ea-414b-aadf-4e174dd1b587 tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.info" returned: 0 in 0.313s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:49 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-3c2e0406-27ea-414b-aadf-4e174dd1b587 tempest-VolumesDeleteCascade-2022122508 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.info is being set with open permissions: ugo+rw Sep 28 17:21:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3c2e0406-27ea-414b-aadf-4e174dd1b587 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:49 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.info Sep 28 17:21:49 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:50 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3c2e0406-27ea-414b-aadf-4e174dd1b587 tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.info" returned: 0 in 0.316s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3c2e0406-27ea-414b-aadf-4e174dd1b587 tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.769s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:50 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-3c2e0406-27ea-414b-aadf-4e174dd1b587 tempest-VolumesDeleteCascade-2022122508 None] Create snapshot completed successfully Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Flow 'volume_create_manager' (c8c736ef-0106-4d68-9ac8-3b7e8f5c498f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f117fe-b9ab-470d-9b69-2c9d691f85a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f117fe-b9ab-470d-9b69-2c9d691f85a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-283737573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9af8353-3870-4ef4-9b5f-60d6688c20e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32daece2f15b4955a8c2cc5512a4e166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:51Z,use_quota=True,user_id='ab35aeaffda04f88b62aad0219bdea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72bbf905-84b8-4ba0-8b0d-b44bf4333db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72bbf905-84b8-4ba0-8b0d-b44bf4333db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05adcb79-5788-4b3e-9583-e71e825ada2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05adcb79-5788-4b3e-9583-e71e825ada2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9af8353-3870-4ef4-9b5f-60d6688c20e7', 'volume_name': 'volume-f9af8353-3870-4ef4-9b5f-60d6688c20e7', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee47fe68-1390-49cc-823d-1cfda76861c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee47fe68-1390-49cc-823d-1cfda76861c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d70bdf0-648c-4362-ad19-358d1e6ae080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:50 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Volume f9af8353-3870-4ef4-9b5f-60d6688c20e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9af8353-3870-4ef4-9b5f-60d6688c20e7', 'volume_size': 1} Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-283737573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9af8353-3870-4ef4-9b5f-60d6688c20e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32daece2f15b4955a8c2cc5512a4e166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:51Z,use_quota=True,user_id='ab35aeaffda04f88b62aad0219bdea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Creating volume f9af8353-3870-4ef4-9b5f-60d6688c20e7 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:50 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:21:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f9af8353-3870-4ef4-9b5f-60d6688c20e7 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:51 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f9af8353-3870-4ef4-9b5f-60d6688c20e7 1073741824 Sep 28 17:21:51 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-bb6c3c1c-3a5f-463f-8d08-3d0221f47896 tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:51 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f9af8353-3870-4ef4-9b5f-60d6688c20e7 1073741824" returned: 0 in 0.536s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f9af8353-3870-4ef4-9b5f-60d6688c20e7 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:51 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f9af8353-3870-4ef4-9b5f-60d6688c20e7 Sep 28 17:21:51 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:51 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f9af8353-3870-4ef4-9b5f-60d6688c20e7" returned: 0 in 0.306s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-bb6c3c1c-3a5f-463f-8d08-3d0221f47896 tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.794s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-bb6c3c1c-3a5f-463f-8d08-3d0221f47896 tempest-VolumesDeleteCascade-2022122508 None] Creating offline snapshot d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19 of volume 32d783e9-8016-404f-9de0-227180ca49d5 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:21:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d70bdf0-648c-4362-ad19-358d1e6ae080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9af8353-3870-4ef4-9b5f-60d6688c20e7', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed04175a-9a12-4e86-994e-df38b6011da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:51 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbee2566-80cb-409d-9072-6e7bad05a68b]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bb6c3c1c-3a5f-463f-8d08-3d0221f47896 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:51 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Volume volume-f9af8353-3870-4ef4-9b5f-60d6688c20e7 (f9af8353-3870-4ef4-9b5f-60d6688c20e7): created successfully Sep 28 17:21:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed04175a-9a12-4e86-994e-df38b6011da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Flow 'volume_create_manager' (c8c736ef-0106-4d68-9ac8-3b7e8f5c498f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:52 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-77886dc5-5f4d-49df-8725-cfab83b60f5c tempest-ProjectReaderTests-1568939303 None] Created volume successfully. Sep 28 17:21:52 devstack sudo[103945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a Sep 28 17:21:52 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:52 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bb6c3c1c-3a5f-463f-8d08-3d0221f47896 tempest-VolumesDeleteCascade-2022122508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a" returned: 0 in 0.529s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:52 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-bb6c3c1c-3a5f-463f-8d08-3d0221f47896 tempest-VolumesDeleteCascade-2022122508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32d783e9-8016-404f-9de0-227180ca49d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:21:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bb6c3c1c-3a5f-463f-8d08-3d0221f47896 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:52 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19 1G Sep 28 17:21:52 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:53 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bb6c3c1c-3a5f-463f-8d08-3d0221f47896 tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19 1G" returned: 0 in 0.659s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bb6c3c1c-3a5f-463f-8d08-3d0221f47896 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:53 devstack sudo[103961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19 Sep 28 17:21:53 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-766075cc-f3db-4a06-97fe-65702722f865 tempest-ProjectReaderTests-1568939303 None] Acquiring lock "cinder-f9af8353-3870-4ef4-9b5f-60d6688c20e7-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-766075cc-f3db-4a06-97fe-65702722f865 tempest-ProjectReaderTests-1568939303 None] Lock "cinder-f9af8353-3870-4ef4-9b5f-60d6688c20e7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-766075cc-f3db-4a06-97fe-65702722f865 tempest-ProjectReaderTests-1568939303 None] Acquiring lock "cinder-quobyte-f9af8353-3870-4ef4-9b5f-60d6688c20e7" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-766075cc-f3db-4a06-97fe-65702722f865 tempest-ProjectReaderTests-1568939303 None] Lock "cinder-quobyte-f9af8353-3870-4ef4-9b5f-60d6688c20e7" acquired by "delete_volume" :: waited 0.025s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:53 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bb6c3c1c-3a5f-463f-8d08-3d0221f47896 tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19" returned: 0 in 0.466s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:53 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-bb6c3c1c-3a5f-463f-8d08-3d0221f47896 tempest-VolumesDeleteCascade-2022122508 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19 is being set with open permissions: ugo+rw Sep 28 17:21:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bb6c3c1c-3a5f-463f-8d08-3d0221f47896 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:53 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88cb6ab-3e0a-4c6a-8b3a-f5a095487aa9]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-766075cc-f3db-4a06-97fe-65702722f865 tempest-ProjectReaderTests-1568939303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f9af8353-3870-4ef4-9b5f-60d6688c20e7 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:53 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19 Sep 28 17:21:53 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:53 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f9af8353-3870-4ef4-9b5f-60d6688c20e7 Sep 28 17:21:53 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:53 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bb6c3c1c-3a5f-463f-8d08-3d0221f47896 tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19" returned: 0 in 0.360s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-bb6c3c1c-3a5f-463f-8d08-3d0221f47896 tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.194s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:54 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-bb6c3c1c-3a5f-463f-8d08-3d0221f47896 tempest-VolumesDeleteCascade-2022122508 None] Create snapshot completed successfully Sep 28 17:21:54 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-766075cc-f3db-4a06-97fe-65702722f865 tempest-ProjectReaderTests-1568939303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f9af8353-3870-4ef4-9b5f-60d6688c20e7" returned: 0 in 0.577s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-766075cc-f3db-4a06-97fe-65702722f865 tempest-ProjectReaderTests-1568939303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f9af8353-3870-4ef4-9b5f-60d6688c20e7 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:54 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f9af8353-3870-4ef4-9b5f-60d6688c20e7 Sep 28 17:21:54 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:54 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-766075cc-f3db-4a06-97fe-65702722f865 tempest-ProjectReaderTests-1568939303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f9af8353-3870-4ef4-9b5f-60d6688c20e7" returned: 0 in 0.299s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:54 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-766075cc-f3db-4a06-97fe-65702722f865 tempest-ProjectReaderTests-1568939303 None] Lock "cinder-quobyte-f9af8353-3870-4ef4-9b5f-60d6688c20e7" released by "delete_volume" :: held 0.951s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:54 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=91,cinder:UPDATE=103,cinder:INSERT=22,cinder:DELETE=12 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:21:54 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-766075cc-f3db-4a06-97fe-65702722f865 tempest-ProjectReaderTests-1568939303 None] Created reservations ['d45a0e0c-c209-417c-8a93-9c57a178aadd', 'c47c0589-fcf4-46c1-b851-ac94f13760d4', '3b1c3fa0-0a68-472d-a3c3-641b662aca37', '6e3d2311-862b-4b5e-b593-7fd24764b42e'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-766075cc-f3db-4a06-97fe-65702722f865 tempest-ProjectReaderTests-1568939303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-766075cc-f3db-4a06-97fe-65702722f865 tempest-ProjectReaderTests-1568939303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:54 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-766075cc-f3db-4a06-97fe-65702722f865 tempest-ProjectReaderTests-1568939303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:54 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-766075cc-f3db-4a06-97fe-65702722f865 tempest-ProjectReaderTests-1568939303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-766075cc-f3db-4a06-97fe-65702722f865 tempest-ProjectReaderTests-1568939303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-766075cc-f3db-4a06-97fe-65702722f865 tempest-ProjectReaderTests-1568939303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:54 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:21:54 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:55 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-766075cc-f3db-4a06-97fe-65702722f865 tempest-ProjectReaderTests-1568939303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.409s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:55 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-766075cc-f3db-4a06-97fe-65702722f865 tempest-ProjectReaderTests-1568939303 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:55 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-766075cc-f3db-4a06-97fe-65702722f865 tempest-ProjectReaderTests-1568939303 None] Deleted volume successfully. Sep 28 17:21:55 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=92,cinder:UPDATE=106,cinder:DELETE=8,cinder:INSERT=26 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:21:55 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-766075cc-f3db-4a06-97fe-65702722f865 tempest-ProjectReaderTests-1568939303 None] Lock "cinder-f9af8353-3870-4ef4-9b5f-60d6688c20e7-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:55 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "cinder-32d783e9-8016-404f-9de0-227180ca49d5-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:55 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-32d783e9-8016-404f-9de0-227180ca49d5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:55 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Performing cascade delete. {{(pid=87061) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 17:21:55 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "cinder-d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:55 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:55 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "cinder-quobyte-32d783e9-8016-404f-9de0-227180ca49d5" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:55 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-quobyte-32d783e9-8016-404f-9de0-227180ca49d5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:55 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "cinder-quobyte-d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:55 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-quobyte-d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:55 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Deleting offline snapshot d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19 of volume 32d783e9-8016-404f-9de0-227180ca49d5 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:21:55 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] snapshot_file for this snap is: volume-32d783e9-8016-404f-9de0-227180ca49d5.d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:21:55 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb45ce6-3b6d-4646-ae66-14b4dac1db3e]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:55 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19 Sep 28 17:21:55 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:55 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19" returned: 0 in 0.452s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:55 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32d783e9-8016-404f-9de0-227180ca49d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[6901c6b5-886f-4044-93d6-ba7fa1833e41]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:56 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a Sep 28 17:21:56 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Flow 'volume_create_manager' (a590b3f4-20b0-46f3-827b-1cb0bde9b13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b7fd819-eeb0-4bcc-8561-f81bbda08d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b7fd819-eeb0-4bcc-8561-f81bbda08d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-167370032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=931b8b75-3243-4392-ad6d-13559c69fbc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32daece2f15b4955a8c2cc5512a4e166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:56Z,use_quota=True,user_id='ab35aeaffda04f88b62aad0219bdea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d4677e-883d-48ba-b660-bde9de4b13ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d4677e-883d-48ba-b660-bde9de4b13ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9bcc3e-ca59-49a7-863e-b00be49fa2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9bcc3e-ca59-49a7-863e-b00be49fa2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '931b8b75-3243-4392-ad6d-13559c69fbc6', 'volume_name': 'volume-931b8b75-3243-4392-ad6d-13559c69fbc6', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a36732-d29c-4210-971c-4b6e975dddee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:56 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a36732-d29c-4210-971c-4b6e975dddee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8054c1e-7f18-4fb1-8ee4-dcf01aff7e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:56 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Volume 931b8b75-3243-4392-ad6d-13559c69fbc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-931b8b75-3243-4392-ad6d-13559c69fbc6', 'volume_size': 1} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-167370032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=931b8b75-3243-4392-ad6d-13559c69fbc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32daece2f15b4955a8c2cc5512a4e166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:56Z,use_quota=True,user_id='ab35aeaffda04f88b62aad0219bdea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Creating volume 931b8b75-3243-4392-ad6d-13559c69fbc6 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:56 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-931b8b75-3243-4392-ad6d-13559c69fbc6 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a" returned: 0 in 0.592s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32d783e9-8016-404f-9de0-227180ca49d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:21:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:56 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-931b8b75-3243-4392-ad6d-13559c69fbc6 1073741824 Sep 28 17:21:56 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:56 devstack sudo[103993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19 Sep 28 17:21:56 devstack sudo[103993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:57 devstack sudo[103993]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19" returned: 0 in 0.563s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:57 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:57 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19 Sep 28 17:21:57 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-931b8b75-3243-4392-ad6d-13559c69fbc6 1073741824" returned: 0 in 0.621s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-931b8b75-3243-4392-ad6d-13559c69fbc6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:57 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-931b8b75-3243-4392-ad6d-13559c69fbc6 Sep 28 17:21:57 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:57 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19" returned: 0 in 0.330s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-quobyte-d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19" released by "_delete_snapshot" :: held 2.087s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-quobyte-32d783e9-8016-404f-9de0-227180ca49d5" released by "delete_snapshot" :: held 2.116s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:57 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-931b8b75-3243-4392-ad6d-13559c69fbc6" returned: 0 in 0.412s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:57 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Created reservations ['22c6a346-9abf-4cd2-8f70-a96a1e482c82', '6fde952b-26f2-4d9b-8b7a-adc3867181da', 'e613c96f-5095-4890-ba98-49fb5c1b7d73', 'a365c1b3-8cbc-46ed-9531-1d0e2de99ebe'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8054c1e-7f18-4fb1-8ee4-dcf01aff7e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-931b8b75-3243-4392-ad6d-13559c69fbc6', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d70610-ac48-47be-936e-458f77609b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:57 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Volume volume-931b8b75-3243-4392-ad6d-13559c69fbc6 (931b8b75-3243-4392-ad6d-13559c69fbc6): created successfully Sep 28 17:21:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d70610-ac48-47be-936e-458f77609b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Flow 'volume_create_manager' (a590b3f4-20b0-46f3-827b-1cb0bde9b13e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:57 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-f2ce76bc-9568-46b0-88ed-824c068204b7 tempest-ProjectReaderTests-1568939303 None] Created volume successfully. Sep 28 17:21:57 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Delete snapshot completed successfully. Sep 28 17:21:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-d0ed8fa9-8e06-4d6d-a6b0-0414fcc48b19-delete_snapshot" released by "delete_snapshot" :: held 2.481s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "cinder-f783780e-a5e8-4f39-a37a-0148fb0d475a-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-f783780e-a5e8-4f39-a37a-0148fb0d475a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "cinder-quobyte-32d783e9-8016-404f-9de0-227180ca49d5" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-quobyte-32d783e9-8016-404f-9de0-227180ca49d5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "cinder-quobyte-f783780e-a5e8-4f39-a37a-0148fb0d475a" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:58 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-quobyte-f783780e-a5e8-4f39-a37a-0148fb0d475a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Deleting offline snapshot f783780e-a5e8-4f39-a37a-0148fb0d475a of volume 32d783e9-8016-404f-9de0-227180ca49d5 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:21:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] snapshot_file for this snap is: volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:21:58 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[419c132e-e1ba-4a75-8758-e9f08880312c]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:58 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a Sep 28 17:21:58 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:58 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a" returned: 0 in 0.539s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32d783e9-8016-404f-9de0-227180ca49d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:21:58 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4ec5526b-139d-4112-b1d0-11e8b55be537 tempest-ProjectReaderTests-1568939303 None] Acquiring lock "cinder-931b8b75-3243-4392-ad6d-13559c69fbc6-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:58 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed573a9e-c2da-4da7-8f80-acefa9180074]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:58 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4ec5526b-139d-4112-b1d0-11e8b55be537 tempest-ProjectReaderTests-1568939303 None] Lock "cinder-931b8b75-3243-4392-ad6d-13559c69fbc6-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:58 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4ec5526b-139d-4112-b1d0-11e8b55be537 tempest-ProjectReaderTests-1568939303 None] Acquiring lock "cinder-quobyte-931b8b75-3243-4392-ad6d-13559c69fbc6" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:58 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4ec5526b-139d-4112-b1d0-11e8b55be537 tempest-ProjectReaderTests-1568939303 None] Lock "cinder-quobyte-931b8b75-3243-4392-ad6d-13559c69fbc6" acquired by "delete_volume" :: waited 0.027s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:58 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4060d4-574a-45cb-be4f-bdade4881adf]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4ec5526b-139d-4112-b1d0-11e8b55be537 tempest-ProjectReaderTests-1568939303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-931b8b75-3243-4392-ad6d-13559c69fbc6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:58 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5 Sep 28 17:21:58 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:59 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-931b8b75-3243-4392-ad6d-13559c69fbc6 Sep 28 17:21:59 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:59 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5" returned: 0 in 0.574s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:59 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a Sep 28 17:21:59 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:59 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4ec5526b-139d-4112-b1d0-11e8b55be537 tempest-ProjectReaderTests-1568939303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-931b8b75-3243-4392-ad6d-13559c69fbc6" returned: 0 in 0.475s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4ec5526b-139d-4112-b1d0-11e8b55be537 tempest-ProjectReaderTests-1568939303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-931b8b75-3243-4392-ad6d-13559c69fbc6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:59 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-931b8b75-3243-4392-ad6d-13559c69fbc6 Sep 28 17:21:59 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:59 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4ec5526b-139d-4112-b1d0-11e8b55be537 tempest-ProjectReaderTests-1568939303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-931b8b75-3243-4392-ad6d-13559c69fbc6" returned: 0 in 0.336s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:59 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4ec5526b-139d-4112-b1d0-11e8b55be537 tempest-ProjectReaderTests-1568939303 None] Lock "cinder-quobyte-931b8b75-3243-4392-ad6d-13559c69fbc6" released by "delete_volume" :: held 0.891s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:59 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a" returned: 0 in 0.542s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:59 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-4ec5526b-139d-4112-b1d0-11e8b55be537 tempest-ProjectReaderTests-1568939303 None] Created reservations ['71f013b6-e62b-4460-b593-547d0d3df66c', '37cb5441-f447-42af-84a0-bf726966b67d', 'eea5a8c8-b1a5-4b2e-81d4-3ecba5a80430', '3a4fc076-7943-45dc-81cc-36783903007e'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:59 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a Sep 28 17:21:59 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4ec5526b-139d-4112-b1d0-11e8b55be537 tempest-ProjectReaderTests-1568939303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4ec5526b-139d-4112-b1d0-11e8b55be537 tempest-ProjectReaderTests-1568939303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4ec5526b-139d-4112-b1d0-11e8b55be537 tempest-ProjectReaderTests-1568939303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4ec5526b-139d-4112-b1d0-11e8b55be537 tempest-ProjectReaderTests-1568939303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4ec5526b-139d-4112-b1d0-11e8b55be537 tempest-ProjectReaderTests-1568939303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4ec5526b-139d-4112-b1d0-11e8b55be537 tempest-ProjectReaderTests-1568939303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:59 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:21:59 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:00 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4ec5526b-139d-4112-b1d0-11e8b55be537 tempest-ProjectReaderTests-1568939303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.336s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-4ec5526b-139d-4112-b1d0-11e8b55be537 tempest-ProjectReaderTests-1568939303 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:00 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-4ec5526b-139d-4112-b1d0-11e8b55be537 tempest-ProjectReaderTests-1568939303 None] Deleted volume successfully. Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4ec5526b-139d-4112-b1d0-11e8b55be537 tempest-ProjectReaderTests-1568939303 None] Lock "cinder-931b8b75-3243-4392-ad6d-13559c69fbc6-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:00 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5.f783780e-a5e8-4f39-a37a-0148fb0d475a" returned: 0 in 0.547s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-quobyte-f783780e-a5e8-4f39-a37a-0148fb0d475a" released by "_delete_snapshot" :: held 2.401s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-quobyte-32d783e9-8016-404f-9de0-227180ca49d5" released by "delete_snapshot" :: held 2.442s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Created reservations ['4671ad4e-ce95-4219-88a4-5be6854b4110', 'a4ec3764-fdca-4784-b3bc-bed9fca0f2d7', 'a89ec417-bfaf-429c-83fe-ac822700ec9f', '420b3ebe-0614-4fc4-9c0e-60a26e5872c6'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:00 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Delete snapshot completed successfully. Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-f783780e-a5e8-4f39-a37a-0148fb0d475a-delete_snapshot" released by "delete_snapshot" :: held 2.768s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Snapshots deleted, issuing volume delete {{(pid=87061) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "cinder-quobyte-32d783e9-8016-404f-9de0-227180ca49d5" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-quobyte-32d783e9-8016-404f-9de0-227180ca49d5" acquired by "delete_volume" :: waited 0.031s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[df87d2bd-dbce-4ed2-8776-a7d980255ed3]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Flow 'volume_create_manager' (1a576cec-5a33-4e92-9820-9bc85785ae91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39daad51-87bf-4f9d-a141-9d3bf71839da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39daad51-87bf-4f9d-a141-9d3bf71839da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1829912061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32daece2f15b4955a8c2cc5512a4e166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:01Z,use_quota=True,user_id='ab35aeaffda04f88b62aad0219bdea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4abf0ee-a42a-44c6-b22a-661e567e3ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4abf0ee-a42a-44c6-b22a-661e567e3ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a4e938-9890-4106-9345-9506e433bc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a4e938-9890-4106-9345-9506e433bc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f', 'volume_name': 'volume-5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866e3b18-938f-41af-8e24-d7f254a9f2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866e3b18-938f-41af-8e24-d7f254a9f2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109cd84b-65fe-4e4d-ad9c-6671c888c423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:00 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Volume 5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f', 'volume_size': 1} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1829912061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32daece2f15b4955a8c2cc5512a4e166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:01Z,use_quota=True,user_id='ab35aeaffda04f88b62aad0219bdea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Creating volume 5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:00 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:22:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:01 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5 Sep 28 17:22:01 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:01 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f 1073741824 Sep 28 17:22:01 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:01 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5" returned: 0 in 0.560s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:01 devstack sudo[104049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5 Sep 28 17:22:01 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:01 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f 1073741824" returned: 0 in 0.639s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:01 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-32d783e9-8016-404f-9de0-227180ca49d5" returned: 0 in 0.322s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:01 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f Sep 28 17:22:01 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:01 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-quobyte-32d783e9-8016-404f-9de0-227180ca49d5" released by "delete_volume" :: held 1.008s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:01 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Created reservations ['53555d16-ac1c-41c3-b6a1-2a06d7941950', '03bc8797-7172-46f5-8a08-ebd84a9bc73d', '7d8ef810-a56f-4ee5-9449-512ab53ef77a', '2eb9ecdf-af92-4f7a-8fcf-3d34b81b448e'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:01 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:22:01 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:02 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f" returned: 0 in 0.338s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109cd84b-65fe-4e4d-ad9c-6671c888c423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f299dd8e-958c-4794-86cb-7bfcf2e7f93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:02 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Volume volume-5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f (5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f): created successfully Sep 28 17:22:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f299dd8e-958c-4794-86cb-7bfcf2e7f93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Flow 'volume_create_manager' (1a576cec-5a33-4e92-9820-9bc85785ae91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:02 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a48a68ea-ee72-43f3-88e9-424ff49b8a8c tempest-ProjectReaderTests-1568939303 None] Created volume successfully. Sep 28 17:22:02 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.435s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:02 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:02 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Deleted volume successfully. Sep 28 17:22:02 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-60a6b735-550d-4b21-b5ff-0c13eb32bbf2 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-32d783e9-8016-404f-9de0-227180ca49d5-delete_volume" released by "delete_volume" :: held 7.107s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2c843b4c-2abe-45ae-b041-fd681c22ac6b tempest-ProjectReaderTests-1568939303 None] Acquiring lock "cinder-5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Flow 'volume_create_manager' (d43d25a3-2948-42bb-a514-8b966b978f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f128ae7-8e7c-4bdb-8cba-a1d253fd1d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2c843b4c-2abe-45ae-b041-fd681c22ac6b tempest-ProjectReaderTests-1568939303 None] Lock "cinder-5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f128ae7-8e7c-4bdb-8cba-a1d253fd1d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1556082196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9a584a-a570-4b0b-88af-b99740dc6d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549f4dbef80140a4bc6679b7975a8ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:03Z,use_quota=True,user_id='56cd857a91ad448c8f88d823a84ecf68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37361216-06d4-477b-b2b8-4288c012897d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37361216-06d4-477b-b2b8-4288c012897d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6352ca23-6dd9-4b41-bef4-ef944873cde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6352ca23-6dd9-4b41-bef4-ef944873cde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac9a584a-a570-4b0b-88af-b99740dc6d4b', 'volume_name': 'volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9304cefc-ebb4-41f7-8062-4bb1e64e83d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9304cefc-ebb4-41f7-8062-4bb1e64e83d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a077f09c-2dbd-44ed-b76c-8ddd62e0c6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:03 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Volume ac9a584a-a570-4b0b-88af-b99740dc6d4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b', 'volume_size': 1} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1556082196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9a584a-a570-4b0b-88af-b99740dc6d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549f4dbef80140a4bc6679b7975a8ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:03Z,use_quota=True,user_id='56cd857a91ad448c8f88d823a84ecf68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Creating volume ac9a584a-a570-4b0b-88af-b99740dc6d4b {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:03 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:03 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b 1073741824 Sep 28 17:22:03 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2c843b4c-2abe-45ae-b041-fd681c22ac6b tempest-ProjectReaderTests-1568939303 None] Acquiring lock "cinder-quobyte-5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2c843b4c-2abe-45ae-b041-fd681c22ac6b tempest-ProjectReaderTests-1568939303 None] Lock "cinder-quobyte-5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f" acquired by "delete_volume" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[32347759-1d90-4e4a-b237-214dcbb4ae36]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c843b4c-2abe-45ae-b041-fd681c22ac6b tempest-ProjectReaderTests-1568939303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Flow 'volume_create_manager' (a125fb1f-b29f-440e-91bb-1028784b2b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db943f0d-8656-442c-b107-e69a0143d123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db943f0d-8656-442c-b107-e69a0143d123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2085649942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8211e7fb-df06-4219-aa1f-ed16a9e12671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b7b00521e245c7a5e21c70b0fa0437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:04Z,use_quota=True,user_id='afbae0aad8cc41efaf713173462e0c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f508d3-4be5-43d5-ae1c-109da6b083f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f508d3-4be5-43d5-ae1c-109da6b083f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa6820d-c2cc-4940-ad90-e6bd9c90e35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa6820d-c2cc-4940-ad90-e6bd9c90e35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8211e7fb-df06-4219-aa1f-ed16a9e12671', 'volume_name': 'volume-8211e7fb-df06-4219-aa1f-ed16a9e12671', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:03 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f Sep 28 17:22:03 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee319f87-d9d4-419f-b4db-0f1dbb7c7449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee319f87-d9d4-419f-b4db-0f1dbb7c7449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b2f34c-948c-4437-bd5d-9a6d6096f2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:03 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Volume 8211e7fb-df06-4219-aa1f-ed16a9e12671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8211e7fb-df06-4219-aa1f-ed16a9e12671', 'volume_size': 1} Sep 28 17:22:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:04 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b 1073741824" returned: 0 in 0.526s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:04 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c843b4c-2abe-45ae-b041-fd681c22ac6b tempest-ProjectReaderTests-1568939303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f" returned: 0 in 0.425s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c843b4c-2abe-45ae-b041-fd681c22ac6b tempest-ProjectReaderTests-1568939303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:04 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f Sep 28 17:22:04 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:04 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b Sep 28 17:22:04 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:04 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c843b4c-2abe-45ae-b041-fd681c22ac6b tempest-ProjectReaderTests-1568939303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f" returned: 0 in 0.292s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:04 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b" returned: 0 in 0.284s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2c843b4c-2abe-45ae-b041-fd681c22ac6b tempest-ProjectReaderTests-1568939303 None] Lock "cinder-quobyte-5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f" released by "delete_volume" :: held 0.800s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.615s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2085649942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8211e7fb-df06-4219-aa1f-ed16a9e12671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b7b00521e245c7a5e21c70b0fa0437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:04Z,use_quota=True,user_id='afbae0aad8cc41efaf713173462e0c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Creating volume 8211e7fb-df06-4219-aa1f-ed16a9e12671 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:04 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a077f09c-2dbd-44ed-b76c-8ddd62e0c6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:04 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671 1073741824 Sep 28 17:22:04 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a89216d-827b-429a-87cf-0530d2b91193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:04 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Volume volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b (ac9a584a-a570-4b0b-88af-b99740dc6d4b): created successfully Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a89216d-827b-429a-87cf-0530d2b91193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Flow 'volume_create_manager' (d43d25a3-2948-42bb-a514-8b966b978f78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:04 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-930685f7-fb14-4f5d-84cc-2cd7a90ecb6b tempest-VolumesDeleteCascade-2022122508 None] Created volume successfully. Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-2c843b4c-2abe-45ae-b041-fd681c22ac6b tempest-ProjectReaderTests-1568939303 None] Created reservations ['786a7abc-e939-42ed-b7a3-2f7f791cfb92', '95b7d42a-11e2-4074-8bd4-518d26be5182', '70d0445e-e29e-40ee-b08b-bec1674eb015', 'df064e35-9198-449e-91b2-b22506d5fd34'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2c843b4c-2abe-45ae-b041-fd681c22ac6b tempest-ProjectReaderTests-1568939303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2c843b4c-2abe-45ae-b041-fd681c22ac6b tempest-ProjectReaderTests-1568939303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2c843b4c-2abe-45ae-b041-fd681c22ac6b tempest-ProjectReaderTests-1568939303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2c843b4c-2abe-45ae-b041-fd681c22ac6b tempest-ProjectReaderTests-1568939303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2c843b4c-2abe-45ae-b041-fd681c22ac6b tempest-ProjectReaderTests-1568939303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c843b4c-2abe-45ae-b041-fd681c22ac6b tempest-ProjectReaderTests-1568939303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:04 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:22:04 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:05 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c843b4c-2abe-45ae-b041-fd681c22ac6b tempest-ProjectReaderTests-1568939303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.318s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:05 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-2c843b4c-2abe-45ae-b041-fd681c22ac6b tempest-ProjectReaderTests-1568939303 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:05 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-2c843b4c-2abe-45ae-b041-fd681c22ac6b tempest-ProjectReaderTests-1568939303 None] Deleted volume successfully. Sep 28 17:22:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2c843b4c-2abe-45ae-b041-fd681c22ac6b tempest-ProjectReaderTests-1568939303 None] Lock "cinder-5d9d6ad4-fcf5-4fc8-b144-f536223c0c4f-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:05 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671 1073741824" returned: 0 in 0.605s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:05 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671 Sep 28 17:22:05 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:05 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671" returned: 0 in 0.330s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b2f34c-948c-4437-bd5d-9a6d6096f2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8211e7fb-df06-4219-aa1f-ed16a9e12671', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c52859-1343-49d3-ae3c-20a7ed785b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:05 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Volume volume-8211e7fb-df06-4219-aa1f-ed16a9e12671 (8211e7fb-df06-4219-aa1f-ed16a9e12671): created successfully Sep 28 17:22:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c52859-1343-49d3-ae3c-20a7ed785b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Flow 'volume_create_manager' (a125fb1f-b29f-440e-91bb-1028784b2b2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:05 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-fa8c3af1-cfa2-4a8e-a96e-2873b1c50db1 tempest-TestImageHashVerification-1618723299 None] Created volume successfully. Sep 28 17:22:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-167ac960-44d7-41de-992c-171c76bf996c tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-167ac960-44d7-41de-992c-171c76bf996c tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-167ac960-44d7-41de-992c-171c76bf996c tempest-VolumesDeleteCascade-2022122508 None] Creating offline snapshot c232ca07-9c08-4057-8b60-299743cc51da of volume ac9a584a-a570-4b0b-88af-b99740dc6d4b {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:22:05 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b22f9f-fa8c-439c-a830-77fb2522eab9]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-167ac960-44d7-41de-992c-171c76bf996c tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:06 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b Sep 28 17:22:06 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:06 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-167ac960-44d7-41de-992c-171c76bf996c tempest-VolumesDeleteCascade-2022122508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b" returned: 0 in 0.469s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-167ac960-44d7-41de-992c-171c76bf996c tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:06 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da 1G Sep 28 17:22:06 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:06 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Flow 'volume_create_manager' (b93b98c9-baaf-4cbd-9c8b-0ed10864b906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2cb1729-e9f4-4f9e-acb1-50894a2afd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2cb1729-e9f4-4f9e-acb1-50894a2afd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1193078005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00fe2c7-284a-4b1e-af52-41c59ffb04b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32daece2f15b4955a8c2cc5512a4e166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:06Z,use_quota=True,user_id='ab35aeaffda04f88b62aad0219bdea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52d0a6d-2b91-4d1a-a14e-dac385df354b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52d0a6d-2b91-4d1a-a14e-dac385df354b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567a7a4b-9d19-45c9-ac9a-0e51d4dfe630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567a7a4b-9d19-45c9-ac9a-0e51d4dfe630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f00fe2c7-284a-4b1e-af52-41c59ffb04b6', 'volume_name': 'volume-f00fe2c7-284a-4b1e-af52-41c59ffb04b6', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978cecdf-b4ae-4372-b97d-9553b08db729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978cecdf-b4ae-4372-b97d-9553b08db729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e539a2d-5584-4844-844f-132169936cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:06 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Volume f00fe2c7-284a-4b1e-af52-41c59ffb04b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f00fe2c7-284a-4b1e-af52-41c59ffb04b6', 'volume_size': 1} Sep 28 17:22:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:22:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:06 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:22:06 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:07 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-167ac960-44d7-41de-992c-171c76bf996c tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da 1G" returned: 0 in 0.590s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-167ac960-44d7-41de-992c-171c76bf996c tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:07 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da Sep 28 17:22:07 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:07 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.346s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:22:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:22:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:22:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e2e15ae0-ef95-4c12-a5dc-b3e39fb5d347 tempest-TestImageHashVerification-1618723299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:07 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-167ac960-44d7-41de-992c-171c76bf996c tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da" returned: 0 in 0.353s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:07 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-167ac960-44d7-41de-992c-171c76bf996c tempest-VolumesDeleteCascade-2022122508 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da is being set with open permissions: ugo+rw Sep 28 17:22:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-167ac960-44d7-41de-992c-171c76bf996c tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:07 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da Sep 28 17:22:07 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:07 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-167ac960-44d7-41de-992c-171c76bf996c tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da" returned: 0 in 0.257s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-167ac960-44d7-41de-992c-171c76bf996c tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:07 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.info Sep 28 17:22:07 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:07 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-167ac960-44d7-41de-992c-171c76bf996c tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.info" returned: 0 in 0.300s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:07 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-167ac960-44d7-41de-992c-171c76bf996c tempest-VolumesDeleteCascade-2022122508 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.info is being set with open permissions: ugo+rw Sep 28 17:22:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-167ac960-44d7-41de-992c-171c76bf996c tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:08 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.info Sep 28 17:22:08 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:08 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-167ac960-44d7-41de-992c-171c76bf996c tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.info" returned: 0 in 0.255s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-167ac960-44d7-41de-992c-171c76bf996c tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.354s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.645s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1193078005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00fe2c7-284a-4b1e-af52-41c59ffb04b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32daece2f15b4955a8c2cc5512a4e166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:06Z,use_quota=True,user_id='ab35aeaffda04f88b62aad0219bdea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Creating volume f00fe2c7-284a-4b1e-af52-41c59ffb04b6 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:08 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:22:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f00fe2c7-284a-4b1e-af52-41c59ffb04b6 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:08 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f00fe2c7-284a-4b1e-af52-41c59ffb04b6 1073741824 Sep 28 17:22:08 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:08 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-167ac960-44d7-41de-992c-171c76bf996c tempest-VolumesDeleteCascade-2022122508 None] Create snapshot completed successfully Sep 28 17:22:08 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f00fe2c7-284a-4b1e-af52-41c59ffb04b6 1073741824" returned: 0 in 0.495s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f00fe2c7-284a-4b1e-af52-41c59ffb04b6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:08 devstack sudo[104122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f00fe2c7-284a-4b1e-af52-41c59ffb04b6 Sep 28 17:22:08 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:09 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f00fe2c7-284a-4b1e-af52-41c59ffb04b6" returned: 0 in 0.284s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e2e15ae0-ef95-4c12-a5dc-b3e39fb5d347 tempest-TestImageHashVerification-1618723299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.832s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e539a2d-5584-4844-844f-132169936cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f00fe2c7-284a-4b1e-af52-41c59ffb04b6', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188550c7-7563-4c85-a7a5-386d2a78bad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[909aaf4e-539a-4c86-a48c-7ec84d10648d]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e2e15ae0-ef95-4c12-a5dc-b3e39fb5d347 tempest-TestImageHashVerification-1618723299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:09 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Volume volume-f00fe2c7-284a-4b1e-af52-41c59ffb04b6 (f00fe2c7-284a-4b1e-af52-41c59ffb04b6): created successfully Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188550c7-7563-4c85-a7a5-386d2a78bad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Flow 'volume_create_manager' (b93b98c9-baaf-4cbd-9c8b-0ed10864b906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:09 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-cc4b099a-8fed-4405-aed4-07e1f28bf4f7 tempest-ProjectReaderTests-1568939303 None] Created volume successfully. Sep 28 17:22:09 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671 Sep 28 17:22:09 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:09 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e2e15ae0-ef95-4c12-a5dc-b3e39fb5d347 tempest-TestImageHashVerification-1618723299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671" returned: 0 in 0.507s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[46665320-0d16-43f3-86da-deb9e463093f]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e2e15ae0-ef95-4c12-a5dc-b3e39fb5d347 tempest-TestImageHashVerification-1618723299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-356de050-f8ed-49ed-8863-bf8858372e91 tempest-ProjectReaderTests-1568939303 None] Acquiring lock "cinder-f00fe2c7-284a-4b1e-af52-41c59ffb04b6-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-356de050-f8ed-49ed-8863-bf8858372e91 tempest-ProjectReaderTests-1568939303 None] Lock "cinder-f00fe2c7-284a-4b1e-af52-41c59ffb04b6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-356de050-f8ed-49ed-8863-bf8858372e91 tempest-ProjectReaderTests-1568939303 None] Acquiring lock "cinder-quobyte-f00fe2c7-284a-4b1e-af52-41c59ffb04b6" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-356de050-f8ed-49ed-8863-bf8858372e91 tempest-ProjectReaderTests-1568939303 None] Lock "cinder-quobyte-f00fe2c7-284a-4b1e-af52-41c59ffb04b6" acquired by "delete_volume" :: waited 0.019s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:09 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671 Sep 28 17:22:09 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b02ec5-bef3-4eed-940d-960c9b91da0a]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-356de050-f8ed-49ed-8863-bf8858372e91 tempest-ProjectReaderTests-1568939303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f00fe2c7-284a-4b1e-af52-41c59ffb04b6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Flow 'volume_create_manager' (253a17a2-c224-40d3-ab60-8b36d7be9d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45eaddcd-18d6-46c6-8b55-7b401dfced26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45eaddcd-18d6-46c6-8b55-7b401dfced26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-680258539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17faa7bf-a62f-477d-8c17-5bdfc1682cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549f4dbef80140a4bc6679b7975a8ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c232ca07-9c08-4057-8b60-299743cc51da,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:10Z,use_quota=True,user_id='56cd857a91ad448c8f88d823a84ecf68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2390dbfe-9daa-41d7-8569-0356c38b8b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2390dbfe-9daa-41d7-8569-0356c38b8b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:10 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f00fe2c7-284a-4b1e-af52-41c59ffb04b6 Sep 28 17:22:10 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69193899-ae40-4f2f-b24f-dae08e1d735d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69193899-ae40-4f2f-b24f-dae08e1d735d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '17faa7bf-a62f-477d-8c17-5bdfc1682cf5', 'volume_name': 'volume-17faa7bf-a62f-477d-8c17-5bdfc1682cf5', 'volume_size': 1, 'snapshot_id': 'c232ca07-9c08-4057-8b60-299743cc51da'}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f473e68a-c560-4c6c-b08f-f1d7692e3954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f473e68a-c560-4c6c-b08f-f1d7692e3954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7652f997-304f-4d23-928e-0498fe5dac3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:10 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Volume 17faa7bf-a62f-477d-8c17-5bdfc1682cf5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-17faa7bf-a62f-477d-8c17-5bdfc1682cf5', 'volume_size': 1, 'snapshot_id': 'c232ca07-9c08-4057-8b60-299743cc51da'} Sep 28 17:22:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:10 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e2e15ae0-ef95-4c12-a5dc-b3e39fb5d347 tempest-TestImageHashVerification-1618723299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671" returned: 0 in 0.521s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e2e15ae0-ef95-4c12-a5dc-b3e39fb5d347 tempest-TestImageHashVerification-1618723299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671 /opt/stack/data/cinder/conversion/8211e7fb-df06-4219-aa1f-ed16a9e12671.temp_image.28c66f21-610f-4e44-aa14-999c80fe3b8cpnbkf5g8.img {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:10 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671 /opt/stack/data/cinder/conversion/8211e7fb-df06-4219-aa1f-ed16a9e12671.temp_image.28c66f21-610f-4e44-aa14-999c80fe3b8cpnbkf5g8.img Sep 28 17:22:10 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:10 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-356de050-f8ed-49ed-8863-bf8858372e91 tempest-ProjectReaderTests-1568939303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f00fe2c7-284a-4b1e-af52-41c59ffb04b6" returned: 0 in 0.460s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-356de050-f8ed-49ed-8863-bf8858372e91 tempest-ProjectReaderTests-1568939303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f00fe2c7-284a-4b1e-af52-41c59ffb04b6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:10 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f00fe2c7-284a-4b1e-af52-41c59ffb04b6 Sep 28 17:22:10 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:10 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-356de050-f8ed-49ed-8863-bf8858372e91 tempest-ProjectReaderTests-1568939303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f00fe2c7-284a-4b1e-af52-41c59ffb04b6" returned: 0 in 0.439s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-356de050-f8ed-49ed-8863-bf8858372e91 tempest-ProjectReaderTests-1568939303 None] Lock "cinder-quobyte-f00fe2c7-284a-4b1e-af52-41c59ffb04b6" released by "delete_volume" :: held 1.001s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:10 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-356de050-f8ed-49ed-8863-bf8858372e91 tempest-ProjectReaderTests-1568939303 None] Created reservations ['0f27de75-21f2-4aa1-8885-ffa542753bb6', '1de8dba6-61ea-4bd4-860a-6956724d4e90', 'fcc781bb-7447-4caf-9010-f05793b352fc', '2e414bfb-1810-4c1e-9bbf-ff104f09206c'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-356de050-f8ed-49ed-8863-bf8858372e91 tempest-ProjectReaderTests-1568939303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-356de050-f8ed-49ed-8863-bf8858372e91 tempest-ProjectReaderTests-1568939303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-356de050-f8ed-49ed-8863-bf8858372e91 tempest-ProjectReaderTests-1568939303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-356de050-f8ed-49ed-8863-bf8858372e91 tempest-ProjectReaderTests-1568939303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-356de050-f8ed-49ed-8863-bf8858372e91 tempest-ProjectReaderTests-1568939303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-356de050-f8ed-49ed-8863-bf8858372e91 tempest-ProjectReaderTests-1568939303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:11 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:22:11 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:11 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-356de050-f8ed-49ed-8863-bf8858372e91 tempest-ProjectReaderTests-1568939303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.403s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:11 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-356de050-f8ed-49ed-8863-bf8858372e91 tempest-ProjectReaderTests-1568939303 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:11 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-356de050-f8ed-49ed-8863-bf8858372e91 tempest-ProjectReaderTests-1568939303 None] Deleted volume successfully. Sep 28 17:22:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-356de050-f8ed-49ed-8863-bf8858372e91 tempest-ProjectReaderTests-1568939303 None] Lock "cinder-f00fe2c7-284a-4b1e-af52-41c59ffb04b6-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:16 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e2e15ae0-ef95-4c12-a5dc-b3e39fb5d347 tempest-TestImageHashVerification-1618723299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671 /opt/stack/data/cinder/conversion/8211e7fb-df06-4219-aa1f-ed16a9e12671.temp_image.28c66f21-610f-4e44-aa14-999c80fe3b8cpnbkf5g8.img" returned: 0 in 6.721s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:16 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e982ce-2422-4f31-ab86-b1995d01521a]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e2e15ae0-ef95-4c12-a5dc-b3e39fb5d347 tempest-TestImageHashVerification-1618723299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:17 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671 Sep 28 17:22:17 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:17 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e2e15ae0-ef95-4c12-a5dc-b3e39fb5d347 tempest-TestImageHashVerification-1618723299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671" returned: 0 in 0.530s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:17 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-e2e15ae0-ef95-4c12-a5dc-b3e39fb5d347 tempest-TestImageHashVerification-1618723299 None] Image conversion details: src /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671, size 1024.00 MB, duration 6.72 sec, destination /opt/stack/data/cinder/conversion/8211e7fb-df06-4219-aa1f-ed16a9e12671.temp_image.28c66f21-610f-4e44-aa14-999c80fe3b8cpnbkf5g8.img {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:22:17 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-e2e15ae0-ef95-4c12-a5dc-b3e39fb5d347 tempest-TestImageHashVerification-1618723299 None] Converted 1024.00 MB image at 152.35 MB/s Sep 28 17:22:17 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-e2e15ae0-ef95-4c12-a5dc-b3e39fb5d347 tempest-TestImageHashVerification-1618723299 None] 28c66f21-610f-4e44-aa14-999c80fe3b8c was raw, no need to convert to raw {{(pid=87061) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 17:22:27 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=47,cinder:INSERT=15,cinder:UPDATE=69,cinder:DELETE=4 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:22:27 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=49,cinder:INSERT=17,cinder:UPDATE=59,cinder:DELETE=6 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e2e15ae0-ef95-4c12-a5dc-b3e39fb5d347 tempest-TestImageHashVerification-1618723299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.242s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e2e15ae0-ef95-4c12-a5dc-b3e39fb5d347 tempest-TestImageHashVerification-1618723299 None] Uploaded volume to glance image-id: 28c66f21-610f-4e44-aa14-999c80fe3b8c. {{(pid=87061) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 27.315s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "cinder-quobyte-c232ca07-9c08-4057-8b60-299743cc51da-17faa7bf-a62f-477d-8c17-5bdfc1682cf5" by "_create_volume_from_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-quobyte-c232ca07-9c08-4057-8b60-299743cc51da-17faa7bf-a62f-477d-8c17-5bdfc1682cf5" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Creating volume 17faa7bf-a62f-477d-8c17-5bdfc1682cf5 from snapshot c232ca07-9c08-4057-8b60-299743cc51da {{(pid=87061) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "cinder-quobyte-17faa7bf-a62f-477d-8c17-5bdfc1682cf5" by "_copy_volume_from_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:37 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e2e15ae0-ef95-4c12-a5dc-b3e39fb5d347 tempest-TestImageHashVerification-1618723299 None] Copy volume to image completed successfully. Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-quobyte-17faa7bf-a62f-477d-8c17-5bdfc1682cf5" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] snapshot: c232ca07-9c08-4057-8b60-299743cc51da, volume: 17faa7bf-a62f-477d-8c17-5bdfc1682cf5, {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[3506e869-8450-4c67-a195-566eb3b9348d]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:37 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da Sep 28 17:22:37 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:37 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da" returned: 0 in 0.396s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcd3eeb-267e-4f61-95f4-e333f438d148]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:38 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b Sep 28 17:22:38 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1aba20b5-05e2-4014-9e0c-c898c0ce5ad7 tempest-TestImageHashVerification-1618723299 None] Acquiring lock "cinder-8211e7fb-df06-4219-aa1f-ed16a9e12671-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1aba20b5-05e2-4014-9e0c-c898c0ce5ad7 tempest-TestImageHashVerification-1618723299 None] Lock "cinder-8211e7fb-df06-4219-aa1f-ed16a9e12671-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1aba20b5-05e2-4014-9e0c-c898c0ce5ad7 tempest-TestImageHashVerification-1618723299 None] Acquiring lock "cinder-quobyte-8211e7fb-df06-4219-aa1f-ed16a9e12671" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1aba20b5-05e2-4014-9e0c-c898c0ce5ad7 tempest-TestImageHashVerification-1618723299 None] Lock "cinder-quobyte-8211e7fb-df06-4219-aa1f-ed16a9e12671" acquired by "delete_volume" :: waited 0.017s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:38 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd39dc6-a063-4405-ad16-59642af47a90]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1aba20b5-05e2-4014-9e0c-c898c0ce5ad7 tempest-TestImageHashVerification-1618723299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:38 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b" returned: 0 in 0.457s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:22:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Creating direct copy from snapshot {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:22:38 devstack cinder-volume[87061]: DEBUG cinder.utils [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Path /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17faa7bf-a62f-477d-8c17-5bdfc1682cf5 not found in is_blk_device check {{(pid=87061) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:22:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17faa7bf-a62f-477d-8c17-5bdfc1682cf5 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:38 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17faa7bf-a62f-477d-8c17-5bdfc1682cf5 Sep 28 17:22:38 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:38 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671 Sep 28 17:22:38 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:38 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1aba20b5-05e2-4014-9e0c-c898c0ce5ad7 tempest-TestImageHashVerification-1618723299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671" returned: 0 in 0.443s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1aba20b5-05e2-4014-9e0c-c898c0ce5ad7 tempest-TestImageHashVerification-1618723299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:38 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671 Sep 28 17:22:38 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:39 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1aba20b5-05e2-4014-9e0c-c898c0ce5ad7 tempest-TestImageHashVerification-1618723299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8211e7fb-df06-4219-aa1f-ed16a9e12671" returned: 0 in 0.529s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1aba20b5-05e2-4014-9e0c-c898c0ce5ad7 tempest-TestImageHashVerification-1618723299 None] Lock "cinder-quobyte-8211e7fb-df06-4219-aa1f-ed16a9e12671" released by "delete_volume" :: held 1.038s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:39 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-1aba20b5-05e2-4014-9e0c-c898c0ce5ad7 tempest-TestImageHashVerification-1618723299 None] Created reservations ['5df4b751-1c88-4b32-ba8e-c515237d5fc2', '5d42f1e9-1117-425c-9271-ed95d83b2bb9', '60419bea-ec35-4903-9416-0c302233bf07', '59956092-0a2a-4fa3-83ef-870c8dc91e5b'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1aba20b5-05e2-4014-9e0c-c898c0ce5ad7 tempest-TestImageHashVerification-1618723299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1aba20b5-05e2-4014-9e0c-c898c0ce5ad7 tempest-TestImageHashVerification-1618723299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1aba20b5-05e2-4014-9e0c-c898c0ce5ad7 tempest-TestImageHashVerification-1618723299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1aba20b5-05e2-4014-9e0c-c898c0ce5ad7 tempest-TestImageHashVerification-1618723299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1aba20b5-05e2-4014-9e0c-c898c0ce5ad7 tempest-TestImageHashVerification-1618723299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1aba20b5-05e2-4014-9e0c-c898c0ce5ad7 tempest-TestImageHashVerification-1618723299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:39 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:22:39 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:40 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1aba20b5-05e2-4014-9e0c-c898c0ce5ad7 tempest-TestImageHashVerification-1618723299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.392s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:40 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1aba20b5-05e2-4014-9e0c-c898c0ce5ad7 tempest-TestImageHashVerification-1618723299 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:40 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-1aba20b5-05e2-4014-9e0c-c898c0ce5ad7 tempest-TestImageHashVerification-1618723299 None] Deleted volume successfully. Sep 28 17:22:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1aba20b5-05e2-4014-9e0c-c898c0ce5ad7 tempest-TestImageHashVerification-1618723299 None] Lock "cinder-8211e7fb-df06-4219-aa1f-ed16a9e12671-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:45 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17faa7bf-a62f-477d-8c17-5bdfc1682cf5" returned: 0 in 7.194s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:45 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Image conversion details: src /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b, size 1024.00 MB, duration 7.20 sec, destination /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17faa7bf-a62f-477d-8c17-5bdfc1682cf5 {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:22:45 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Converted 1024.00 MB image at 142.30 MB/s Sep 28 17:22:45 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17faa7bf-a62f-477d-8c17-5bdfc1682cf5 is being set with open permissions: ugo+rw Sep 28 17:22:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17faa7bf-a62f-477d-8c17-5bdfc1682cf5 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:45 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17faa7bf-a62f-477d-8c17-5bdfc1682cf5 Sep 28 17:22:45 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:45 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17faa7bf-a62f-477d-8c17-5bdfc1682cf5" returned: 0 in 0.257s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:45 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-quobyte-17faa7bf-a62f-477d-8c17-5bdfc1682cf5" released by "_copy_volume_from_snapshot" :: held 8.399s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:45 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-quobyte-c232ca07-9c08-4057-8b60-299743cc51da-17faa7bf-a62f-477d-8c17-5bdfc1682cf5" released by "_create_volume_from_snapshot" :: held 8.473s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.501s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7652f997-304f-4d23-928e-0498fe5dac3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17faa7bf-a62f-477d-8c17-5bdfc1682cf5', 'volume_size': 1, 'snapshot_id': 'c232ca07-9c08-4057-8b60-299743cc51da'}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d679ca-a29c-40df-98d2-e9293573b492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:45 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Volume volume-17faa7bf-a62f-477d-8c17-5bdfc1682cf5 (17faa7bf-a62f-477d-8c17-5bdfc1682cf5): created successfully Sep 28 17:22:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d679ca-a29c-40df-98d2-e9293573b492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Flow 'volume_create_manager' (253a17a2-c224-40d3-ab60-8b36d7be9d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:45 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-46391fca-30f6-407e-890b-df654f38eb8c tempest-VolumesDeleteCascade-2022122508 None] Created volume successfully. Sep 28 17:22:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "cinder-ac9a584a-a570-4b0b-88af-b99740dc6d4b-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-ac9a584a-a570-4b0b-88af-b99740dc6d4b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Performing cascade delete. {{(pid=87061) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 17:22:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "cinder-c232ca07-9c08-4057-8b60-299743cc51da-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-c232ca07-9c08-4057-8b60-299743cc51da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "cinder-quobyte-ac9a584a-a570-4b0b-88af-b99740dc6d4b" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-quobyte-ac9a584a-a570-4b0b-88af-b99740dc6d4b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "cinder-quobyte-c232ca07-9c08-4057-8b60-299743cc51da" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-quobyte-c232ca07-9c08-4057-8b60-299743cc51da" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Deleting offline snapshot c232ca07-9c08-4057-8b60-299743cc51da of volume ac9a584a-a570-4b0b-88af-b99740dc6d4b {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:22:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] snapshot_file for this snap is: volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:22:47 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04ec165-1a7a-4057-859c-b19c2401566b]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:47 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da Sep 28 17:22:47 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:47 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da" returned: 0 in 0.443s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:22:47 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de6babb-ff46-4806-8cb8-88166d030363]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:47 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b Sep 28 17:22:47 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:48 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b" returned: 0 in 0.656s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:48 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da Sep 28 17:22:48 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:48 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da" returned: 0 in 0.449s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:48 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da Sep 28 17:22:48 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:49 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b.c232ca07-9c08-4057-8b60-299743cc51da" returned: 0 in 0.337s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:49 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-quobyte-c232ca07-9c08-4057-8b60-299743cc51da" released by "_delete_snapshot" :: held 2.093s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:49 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-quobyte-ac9a584a-a570-4b0b-88af-b99740dc6d4b" released by "delete_snapshot" :: held 2.118s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:49 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Created reservations ['610ea09d-31a6-462a-8c2f-1c2d81cff3e1', '9d7e9e0c-777c-458e-80fd-0d2c7dc810e0', 'cc4bb9a4-1530-4fec-b484-0250b9591d37', '0878acd3-be24-4a38-805b-c3ec11d9a497'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:49 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Delete snapshot completed successfully. Sep 28 17:22:49 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-c232ca07-9c08-4057-8b60-299743cc51da-delete_snapshot" released by "delete_snapshot" :: held 2.364s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Snapshots deleted, issuing volume delete {{(pid=87061) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 17:22:49 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "cinder-quobyte-ac9a584a-a570-4b0b-88af-b99740dc6d4b" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:49 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-quobyte-ac9a584a-a570-4b0b-88af-b99740dc6d4b" acquired by "delete_volume" :: waited 0.019s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:49 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b7ce3c-2368-456e-b695-0b28149a5355]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:49 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b Sep 28 17:22:49 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:50 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b" returned: 0 in 0.454s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:50 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b Sep 28 17:22:50 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:50 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac9a584a-a570-4b0b-88af-b99740dc6d4b" returned: 0 in 0.315s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:50 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-quobyte-ac9a584a-a570-4b0b-88af-b99740dc6d4b" released by "delete_volume" :: held 0.862s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:50 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Created reservations ['8fcc2d6f-5ce2-4ce9-b227-e68fcec77a47', '2812531c-cb6d-42b0-91a3-1e0a51351d99', 'a35941bf-5de7-442d-b732-04a752d588c3', 'f189f802-af6f-4369-9594-006844aa1eb2'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:50 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:50 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:50 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:22:50 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:50 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.301s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:50 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:50 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Deleted volume successfully. Sep 28 17:22:50 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7f925523-5d1e-478b-823d-b87b5fd618c9 tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-ac9a584a-a570-4b0b-88af-b99740dc6d4b-delete_volume" released by "delete_volume" :: held 3.824s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:51 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8ae443ae-da4f-43da-8a2e-284ae14dae2a tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "cinder-17faa7bf-a62f-477d-8c17-5bdfc1682cf5-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:51 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8ae443ae-da4f-43da-8a2e-284ae14dae2a tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-17faa7bf-a62f-477d-8c17-5bdfc1682cf5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:51 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8ae443ae-da4f-43da-8a2e-284ae14dae2a tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "cinder-quobyte-17faa7bf-a62f-477d-8c17-5bdfc1682cf5" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:51 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8ae443ae-da4f-43da-8a2e-284ae14dae2a tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-quobyte-17faa7bf-a62f-477d-8c17-5bdfc1682cf5" acquired by "delete_volume" :: waited 0.015s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:51 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ae993b-f23e-4324-9068-2229b1ebbe29]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8ae443ae-da4f-43da-8a2e-284ae14dae2a tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17faa7bf-a62f-477d-8c17-5bdfc1682cf5 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:51 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17faa7bf-a62f-477d-8c17-5bdfc1682cf5 Sep 28 17:22:51 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:52 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8ae443ae-da4f-43da-8a2e-284ae14dae2a tempest-VolumesDeleteCascade-2022122508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17faa7bf-a62f-477d-8c17-5bdfc1682cf5" returned: 0 in 0.498s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8ae443ae-da4f-43da-8a2e-284ae14dae2a tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17faa7bf-a62f-477d-8c17-5bdfc1682cf5 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:52 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17faa7bf-a62f-477d-8c17-5bdfc1682cf5 Sep 28 17:22:52 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:52 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8ae443ae-da4f-43da-8a2e-284ae14dae2a tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-17faa7bf-a62f-477d-8c17-5bdfc1682cf5" returned: 0 in 0.301s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:52 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8ae443ae-da4f-43da-8a2e-284ae14dae2a tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-quobyte-17faa7bf-a62f-477d-8c17-5bdfc1682cf5" released by "delete_volume" :: held 0.860s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:52 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-8ae443ae-da4f-43da-8a2e-284ae14dae2a tempest-VolumesDeleteCascade-2022122508 None] Created reservations ['e271b409-bf81-4e62-8411-21c6fff01c6c', 'f5f89d9e-1cb7-4d51-8436-9037ea61255a', 'b03d3e77-acfa-46df-8582-2a13adb4199c', '8465d2a6-d5bb-4ffc-bf89-d1ce66cb3ede'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8ae443ae-da4f-43da-8a2e-284ae14dae2a tempest-VolumesDeleteCascade-2022122508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8ae443ae-da4f-43da-8a2e-284ae14dae2a tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:52 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8ae443ae-da4f-43da-8a2e-284ae14dae2a tempest-VolumesDeleteCascade-2022122508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:52 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8ae443ae-da4f-43da-8a2e-284ae14dae2a tempest-VolumesDeleteCascade-2022122508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8ae443ae-da4f-43da-8a2e-284ae14dae2a tempest-VolumesDeleteCascade-2022122508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8ae443ae-da4f-43da-8a2e-284ae14dae2a tempest-VolumesDeleteCascade-2022122508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:52 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:22:52 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:53 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8ae443ae-da4f-43da-8a2e-284ae14dae2a tempest-VolumesDeleteCascade-2022122508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.386s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:53 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-8ae443ae-da4f-43da-8a2e-284ae14dae2a tempest-VolumesDeleteCascade-2022122508 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:53 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-8ae443ae-da4f-43da-8a2e-284ae14dae2a tempest-VolumesDeleteCascade-2022122508 None] Deleted volume successfully. Sep 28 17:22:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8ae443ae-da4f-43da-8a2e-284ae14dae2a tempest-VolumesDeleteCascade-2022122508 None] Lock "cinder-17faa7bf-a62f-477d-8c17-5bdfc1682cf5-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:57 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Flow 'volume_create_manager' (053b7355-5e33-4009-a1f4-383fbc5ee4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a1f67a-3650-4643-953b-8872886bb8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a1f67a-3650-4643-953b-8872886bb8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1796720930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd86d06-0b44-4ffd-bb2c-890701e5a0f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c00cbdde2c4958ada36e646125a61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:57Z,use_quota=True,user_id='b425589323c6421189a13067a621d590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da3a82c3-d980-45bd-a29f-b86f62c8d8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da3a82c3-d980-45bd-a29f-b86f62c8d8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612c565f-751f-41ac-b0ae-bcb97b52a7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612c565f-751f-41ac-b0ae-bcb97b52a7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cd86d06-0b44-4ffd-bb2c-890701e5a0f2', 'volume_name': 'volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b162c9a9-8285-4f74-acb3-211e8dc197cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b162c9a9-8285-4f74-acb3-211e8dc197cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca0dd22-f9e2-407d-97b9-a494d2f9b2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:57 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Volume 5cd86d06-0b44-4ffd-bb2c-890701e5a0f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2', 'volume_size': 1} Sep 28 17:22:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1796720930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd86d06-0b44-4ffd-bb2c-890701e5a0f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c00cbdde2c4958ada36e646125a61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:57Z,use_quota=True,user_id='b425589323c6421189a13067a621d590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Creating volume 5cd86d06-0b44-4ffd-bb2c-890701e5a0f2 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:57 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:22:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:57 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2 1073741824 Sep 28 17:22:57 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:58 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2 1073741824" returned: 0 in 0.536s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:58 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2 Sep 28 17:22:58 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:58 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2" returned: 0 in 0.309s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca0dd22-f9e2-407d-97b9-a494d2f9b2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae619a7-c18f-49bf-a4b1-ea0070ae8522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:58 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Volume volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2 (5cd86d06-0b44-4ffd-bb2c-890701e5a0f2): created successfully Sep 28 17:22:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae619a7-c18f-49bf-a4b1-ea0070ae8522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Flow 'volume_create_manager' (053b7355-5e33-4009-a1f4-383fbc5ee4a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:58 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d126cada-385a-4164-abfb-e6ffef7d3215 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Created volume successfully. Sep 28 17:22:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3b83eb68-c18e-4185-87f2-afe4265d63bc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3b83eb68-c18e-4185-87f2-afe4265d63bc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-3b83eb68-c18e-4185-87f2-afe4265d63bc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Creating offline snapshot 82db1b93-3639-4705-bf63-ba02e3343484 of volume 5cd86d06-0b44-4ffd-bb2c-890701e5a0f2 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:23:00 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22fbfc1-2db9-4400-a88f-ac8f664d2c1f]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b83eb68-c18e-4185-87f2-afe4265d63bc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:00 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Flow 'volume_create_manager' (6b0c7b34-91d6-4054-a47b-7ef01eed83cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ae44abb-c28c-4a69-a182-1fc4a44542b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ae44abb-c28c-4a69-a182-1fc4a44542b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1567200953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e20588dc-3a23-409f-b613-7b3a35363dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3a4bb85ba647fe91b1265d5a0af568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:00Z,use_quota=True,user_id='aa1dda6563f24d0d886e3c1084c7e17f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb969dbb-d385-434d-a21a-52670fb87fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb969dbb-d385-434d-a21a-52670fb87fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50de2404-bb8b-4ef2-a254-47af67a0a086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50de2404-bb8b-4ef2-a254-47af67a0a086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e20588dc-3a23-409f-b613-7b3a35363dac', 'volume_name': 'volume-e20588dc-3a23-409f-b613-7b3a35363dac', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2936e57d-b6c6-4054-8604-4e8f341fc8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2936e57d-b6c6-4054-8604-4e8f341fc8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (728b4fc4-d81b-442d-b14a-dd0ed76799ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:00 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Volume e20588dc-3a23-409f-b613-7b3a35363dac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e20588dc-3a23-409f-b613-7b3a35363dac', 'volume_size': 1} Sep 28 17:23:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:00 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2 Sep 28 17:23:00 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:00 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b83eb68-c18e-4185-87f2-afe4265d63bc tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2" returned: 0 in 0.389s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b83eb68-c18e-4185-87f2-afe4265d63bc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.82db1b93-3639-4705-bf63-ba02e3343484 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:00 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.82db1b93-3639-4705-bf63-ba02e3343484 1G Sep 28 17:23:00 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:00 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b83eb68-c18e-4185-87f2-afe4265d63bc tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.82db1b93-3639-4705-bf63-ba02e3343484 1G" returned: 0 in 0.515s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b83eb68-c18e-4185-87f2-afe4265d63bc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.82db1b93-3639-4705-bf63-ba02e3343484 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:00 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.82db1b93-3639-4705-bf63-ba02e3343484 Sep 28 17:23:00 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:01 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b83eb68-c18e-4185-87f2-afe4265d63bc tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.82db1b93-3639-4705-bf63-ba02e3343484" returned: 0 in 0.370s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:01 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-3b83eb68-c18e-4185-87f2-afe4265d63bc tempest-CreateVolumesFromSnapshotTest-1709753946 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.82db1b93-3639-4705-bf63-ba02e3343484 is being set with open permissions: ugo+rw Sep 28 17:23:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b83eb68-c18e-4185-87f2-afe4265d63bc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.82db1b93-3639-4705-bf63-ba02e3343484 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:01 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.82db1b93-3639-4705-bf63-ba02e3343484 Sep 28 17:23:01 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:01 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b83eb68-c18e-4185-87f2-afe4265d63bc tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.82db1b93-3639-4705-bf63-ba02e3343484" returned: 0 in 0.281s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b83eb68-c18e-4185-87f2-afe4265d63bc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:01 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.info Sep 28 17:23:01 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:01 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b83eb68-c18e-4185-87f2-afe4265d63bc tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.info" returned: 0 in 0.294s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:01 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-3b83eb68-c18e-4185-87f2-afe4265d63bc tempest-CreateVolumesFromSnapshotTest-1709753946 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.info is being set with open permissions: ugo+rw Sep 28 17:23:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b83eb68-c18e-4185-87f2-afe4265d63bc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:01 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.info Sep 28 17:23:01 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:02 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3b83eb68-c18e-4185-87f2-afe4265d63bc tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.info" returned: 0 in 0.287s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3b83eb68-c18e-4185-87f2-afe4265d63bc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.249s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.113s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1567200953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e20588dc-3a23-409f-b613-7b3a35363dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3a4bb85ba647fe91b1265d5a0af568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:00Z,use_quota=True,user_id='aa1dda6563f24d0d886e3c1084c7e17f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Creating volume e20588dc-3a23-409f-b613-7b3a35363dac {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:02 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:23:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e20588dc-3a23-409f-b613-7b3a35363dac 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:02 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e20588dc-3a23-409f-b613-7b3a35363dac 1073741824 Sep 28 17:23:02 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:02 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-3b83eb68-c18e-4185-87f2-afe4265d63bc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Create snapshot completed successfully Sep 28 17:23:02 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e20588dc-3a23-409f-b613-7b3a35363dac 1073741824" returned: 0 in 0.538s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e20588dc-3a23-409f-b613-7b3a35363dac {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:02 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e20588dc-3a23-409f-b613-7b3a35363dac Sep 28 17:23:02 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:03 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e20588dc-3a23-409f-b613-7b3a35363dac" returned: 0 in 0.365s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (728b4fc4-d81b-442d-b14a-dd0ed76799ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e20588dc-3a23-409f-b613-7b3a35363dac', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7ad4c2-29ed-46d7-97be-d2d7923b9b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:03 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Volume volume-e20588dc-3a23-409f-b613-7b3a35363dac (e20588dc-3a23-409f-b613-7b3a35363dac): created successfully Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7ad4c2-29ed-46d7-97be-d2d7923b9b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Flow 'volume_create_manager' (6b0c7b34-91d6-4054-a47b-7ef01eed83cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:03 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-8efe9186-38a0-4fd2-adca-e8fe14a607cc tempest-VolumesTransfersV355Test-1664800179 None] Created volume successfully. Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Flow 'volume_create_manager' (95606cf7-a8e8-472d-be42-f9701972e362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45375033-cd8d-42fb-880c-6dafcd5dc052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45375033-cd8d-42fb-880c-6dafcd5dc052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1841964577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde94c9d-c372-473e-8b75-c47d68e5d673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c00cbdde2c4958ada36e646125a61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:03Z,use_quota=True,user_id='b425589323c6421189a13067a621d590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d837cb0c-c4de-4205-9d15-b768ec10c2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d837cb0c-c4de-4205-9d15-b768ec10c2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6016034d-0c2b-4190-8afa-c7f89fbc5e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6016034d-0c2b-4190-8afa-c7f89fbc5e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cde94c9d-c372-473e-8b75-c47d68e5d673', 'volume_name': 'volume-cde94c9d-c372-473e-8b75-c47d68e5d673', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83763867-94a2-407b-99a3-5a63e8c64ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83763867-94a2-407b-99a3-5a63e8c64ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64db67cc-59cd-4b0d-ae6b-f88ba3523451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:03 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Volume cde94c9d-c372-473e-8b75-c47d68e5d673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cde94c9d-c372-473e-8b75-c47d68e5d673', 'volume_size': 1} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1841964577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde94c9d-c372-473e-8b75-c47d68e5d673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c00cbdde2c4958ada36e646125a61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:03Z,use_quota=True,user_id='b425589323c6421189a13067a621d590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Creating volume cde94c9d-c372-473e-8b75-c47d68e5d673 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:03 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:23:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cde94c9d-c372-473e-8b75-c47d68e5d673 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:03 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cde94c9d-c372-473e-8b75-c47d68e5d673 1073741824 Sep 28 17:23:03 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Flow 'volume_create_manager' (e52ca78b-2d7f-4ef4-a839-413c9c8e5d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e24b4f8-66df-484b-9554-21b7685c64c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e24b4f8-66df-484b-9554-21b7685c64c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1399808191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81c1781b-618b-46da-8488-6b5ebdc31928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c00cbdde2c4958ada36e646125a61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:04Z,use_quota=True,user_id='b425589323c6421189a13067a621d590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c508e2f-4ca4-44a6-ab8c-931deb37c4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c508e2f-4ca4-44a6-ab8c-931deb37c4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0b7914-4a0a-436d-a48b-fa10809a93f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0b7914-4a0a-436d-a48b-fa10809a93f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81c1781b-618b-46da-8488-6b5ebdc31928', 'volume_name': 'volume-81c1781b-618b-46da-8488-6b5ebdc31928', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd928ea-bec5-4733-ba12-b1b45d8ed761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd928ea-bec5-4733-ba12-b1b45d8ed761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debe45e6-f7c5-458c-a916-b12b39c25201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Volume 81c1781b-618b-46da-8488-6b5ebdc31928: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81c1781b-618b-46da-8488-6b5ebdc31928', 'volume_size': 1} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:04 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cde94c9d-c372-473e-8b75-c47d68e5d673 1073741824" returned: 0 in 0.677s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cde94c9d-c372-473e-8b75-c47d68e5d673 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:04 devstack sudo[104352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cde94c9d-c372-473e-8b75-c47d68e5d673 Sep 28 17:23:04 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Flow 'volume_create_manager' (08a40c57-ab75-497a-bbc2-f378843b65b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd7a8f8-c100-43ec-902e-ce458496908f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd7a8f8-c100-43ec-902e-ce458496908f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1376297348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ddbc09b-1878-441c-a82e-78dfabb737c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c00cbdde2c4958ada36e646125a61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:05Z,use_quota=True,user_id='b425589323c6421189a13067a621d590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea748eef-1149-4598-98fc-4d65ff4368d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea748eef-1149-4598-98fc-4d65ff4368d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5581e309-7f75-4b83-96ec-f316e2ff2933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5581e309-7f75-4b83-96ec-f316e2ff2933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ddbc09b-1878-441c-a82e-78dfabb737c3', 'volume_name': 'volume-7ddbc09b-1878-441c-a82e-78dfabb737c3', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c661fcf-16dc-403a-9b77-d21bce5e1346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c661fcf-16dc-403a-9b77-d21bce5e1346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:04 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b57dd6-1ba2-4405-a8ad-a3dd468b8d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Volume 7ddbc09b-1878-441c-a82e-78dfabb737c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ddbc09b-1878-441c-a82e-78dfabb737c3', 'volume_size': 1} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cde94c9d-c372-473e-8b75-c47d68e5d673" returned: 0 in 0.442s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.590s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1399808191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81c1781b-618b-46da-8488-6b5ebdc31928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c00cbdde2c4958ada36e646125a61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:04Z,use_quota=True,user_id='b425589323c6421189a13067a621d590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Creating volume 81c1781b-618b-46da-8488-6b5ebdc31928 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:04 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-81c1781b-618b-46da-8488-6b5ebdc31928 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:04 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-81c1781b-618b-46da-8488-6b5ebdc31928 1073741824 Sep 28 17:23:04 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64db67cc-59cd-4b0d-ae6b-f88ba3523451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cde94c9d-c372-473e-8b75-c47d68e5d673', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f53a199-edca-4f63-8217-57bc5974e7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Volume volume-cde94c9d-c372-473e-8b75-c47d68e5d673 (cde94c9d-c372-473e-8b75-c47d68e5d673): created successfully Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f53a199-edca-4f63-8217-57bc5974e7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Flow 'volume_create_manager' (95606cf7-a8e8-472d-be42-f9701972e362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:05 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-b5257c5b-a16a-4369-9299-723ded115c4d tempest-CreateVolumesFromSnapshotTest-1709753946 None] Created volume successfully. Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Flow 'volume_create_manager' (343613f8-20c3-46c4-aab0-029b252902f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d191928-8a13-4acf-aa0e-cbad00de4b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:05 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-59372da5-09a3-4e03-99db-f7b325b4e8dd tempest-VolumesTransfersV355Test-1374438622 None] Transfer volume completed successfully. Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d191928-8a13-4acf-aa0e-cbad00de4b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-244561836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7ba08c-e1ad-493f-b9f8-c165f522dc4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c00cbdde2c4958ada36e646125a61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:05Z,use_quota=True,user_id='b425589323c6421189a13067a621d590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16bfa7d5-bf32-40dd-b6ba-9fc139da160a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16bfa7d5-bf32-40dd-b6ba-9fc139da160a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5119f0-8b04-4780-80a6-b8a5f31c2b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5119f0-8b04-4780-80a6-b8a5f31c2b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b7ba08c-e1ad-493f-b9f8-c165f522dc4b', 'volume_name': 'volume-4b7ba08c-e1ad-493f-b9f8-c165f522dc4b', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bcc5772-60cb-4490-a71b-6a524e456457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bcc5772-60cb-4490-a71b-6a524e456457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f090e4cd-5c61-40c4-9925-e9fc6eb5576f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:05 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Volume 4b7ba08c-e1ad-493f-b9f8-c165f522dc4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b7ba08c-e1ad-493f-b9f8-c165f522dc4b', 'volume_size': 1} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:05 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-81c1781b-618b-46da-8488-6b5ebdc31928 1073741824" returned: 0 in 0.619s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-81c1781b-618b-46da-8488-6b5ebdc31928 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:05 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-81c1781b-618b-46da-8488-6b5ebdc31928 Sep 28 17:23:05 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Flow 'volume_create_manager' (f613e8df-a2cf-4d60-9b4f-f16ef0fb685f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94fe5f64-a3c4-4373-a061-a583b629574f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94fe5f64-a3c4-4373-a061-a583b629574f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1261722511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c2f9af1-c5e0-4dd7-a864-b165c3011467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c00cbdde2c4958ada36e646125a61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:06Z,use_quota=True,user_id='b425589323c6421189a13067a621d590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94113a64-fd46-474e-bc11-e3fe55568cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94113a64-fd46-474e-bc11-e3fe55568cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (945afc39-d4fd-45d0-abca-04d6ef81a167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (945afc39-d4fd-45d0-abca-04d6ef81a167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c2f9af1-c5e0-4dd7-a864-b165c3011467', 'volume_name': 'volume-7c2f9af1-c5e0-4dd7-a864-b165c3011467', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d211ab56-1fab-411e-9d6e-71029b831840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d211ab56-1fab-411e-9d6e-71029b831840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (992f06e0-1359-4fd7-a8db-7992bf10a514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:05 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Volume 7c2f9af1-c5e0-4dd7-a864-b165c3011467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c2f9af1-c5e0-4dd7-a864-b165c3011467', 'volume_size': 1} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:05 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-81c1781b-618b-46da-8488-6b5ebdc31928" returned: 0 in 0.346s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.033s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1376297348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ddbc09b-1878-441c-a82e-78dfabb737c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c00cbdde2c4958ada36e646125a61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:05Z,use_quota=True,user_id='b425589323c6421189a13067a621d590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Creating volume 7ddbc09b-1878-441c-a82e-78dfabb737c3 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:05 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ddbc09b-1878-441c-a82e-78dfabb737c3 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:05 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ddbc09b-1878-441c-a82e-78dfabb737c3 1073741824 Sep 28 17:23:05 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debe45e6-f7c5-458c-a916-b12b39c25201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81c1781b-618b-46da-8488-6b5ebdc31928', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72f46f0f-6f91-4213-8a43-e4a937d4b1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:05 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Volume volume-81c1781b-618b-46da-8488-6b5ebdc31928 (81c1781b-618b-46da-8488-6b5ebdc31928): created successfully Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72f46f0f-6f91-4213-8a43-e4a937d4b1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Flow 'volume_create_manager' (e52ca78b-2d7f-4ef4-a839-413c9c8e5d01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:05 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-29d19916-9796-4dfa-a1d0-3aeba4c8c88b tempest-CreateVolumesFromSnapshotTest-1709753946 None] Created volume successfully. Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9b2b0233-e6b0-4857-9000-5769a10ba24d tempest-VolumesTransfersV355Test-1641023739 None] Acquiring lock "cinder-e20588dc-3a23-409f-b613-7b3a35363dac-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9b2b0233-e6b0-4857-9000-5769a10ba24d tempest-VolumesTransfersV355Test-1641023739 None] Lock "cinder-e20588dc-3a23-409f-b613-7b3a35363dac-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9b2b0233-e6b0-4857-9000-5769a10ba24d tempest-VolumesTransfersV355Test-1641023739 None] Acquiring lock "cinder-quobyte-e20588dc-3a23-409f-b613-7b3a35363dac" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9b2b0233-e6b0-4857-9000-5769a10ba24d tempest-VolumesTransfersV355Test-1641023739 None] Lock "cinder-quobyte-e20588dc-3a23-409f-b613-7b3a35363dac" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de129c1-7970-42b6-9c8e-206add4ccd6a]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9b2b0233-e6b0-4857-9000-5769a10ba24d tempest-VolumesTransfersV355Test-1641023739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e20588dc-3a23-409f-b613-7b3a35363dac {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:06 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e20588dc-3a23-409f-b613-7b3a35363dac Sep 28 17:23:06 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:06 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ddbc09b-1878-441c-a82e-78dfabb737c3 1073741824" returned: 0 in 0.538s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ddbc09b-1878-441c-a82e-78dfabb737c3 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:06 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ddbc09b-1878-441c-a82e-78dfabb737c3 Sep 28 17:23:06 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:06 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9b2b0233-e6b0-4857-9000-5769a10ba24d tempest-VolumesTransfersV355Test-1641023739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e20588dc-3a23-409f-b613-7b3a35363dac" returned: 0 in 0.430s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9b2b0233-e6b0-4857-9000-5769a10ba24d tempest-VolumesTransfersV355Test-1641023739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e20588dc-3a23-409f-b613-7b3a35363dac {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:06 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e20588dc-3a23-409f-b613-7b3a35363dac Sep 28 17:23:06 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:06 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ddbc09b-1878-441c-a82e-78dfabb737c3" returned: 0 in 0.279s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.352s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-244561836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7ba08c-e1ad-493f-b9f8-c165f522dc4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c00cbdde2c4958ada36e646125a61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:05Z,use_quota=True,user_id='b425589323c6421189a13067a621d590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Creating volume 4b7ba08c-e1ad-493f-b9f8-c165f522dc4b {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:06 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4b7ba08c-e1ad-493f-b9f8-c165f522dc4b 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:06 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4b7ba08c-e1ad-493f-b9f8-c165f522dc4b 1073741824 Sep 28 17:23:06 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:06 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:23:06 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b57dd6-1ba2-4405-a8ad-a3dd468b8d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ddbc09b-1878-441c-a82e-78dfabb737c3', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638e0330-8fc8-4f54-b490-3ad1e27905a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:06 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Volume volume-7ddbc09b-1878-441c-a82e-78dfabb737c3 (7ddbc09b-1878-441c-a82e-78dfabb737c3): created successfully Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638e0330-8fc8-4f54-b490-3ad1e27905a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Flow 'volume_create_manager' (08a40c57-ab75-497a-bbc2-f378843b65b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:06 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-08e86da5-5f5c-4314-ac45-2a73b984fb91 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Created volume successfully. Sep 28 17:23:06 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9b2b0233-e6b0-4857-9000-5769a10ba24d tempest-VolumesTransfersV355Test-1641023739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e20588dc-3a23-409f-b613-7b3a35363dac" returned: 0 in 0.350s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9b2b0233-e6b0-4857-9000-5769a10ba24d tempest-VolumesTransfersV355Test-1641023739 None] Lock "cinder-quobyte-e20588dc-3a23-409f-b613-7b3a35363dac" released by "delete_volume" :: held 0.839s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-9b2b0233-e6b0-4857-9000-5769a10ba24d tempest-VolumesTransfersV355Test-1641023739 None] Created reservations ['221c6582-64fb-4111-aec4-c392a718fc04', 'ec8ad1be-4b97-4d56-af2e-7a93c783c0fe', '3fe8d367-02e4-407d-b590-1f2e32c10794', 'd49c0a25-fc9a-4e02-8c8d-70a0b859e8e2'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:07 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.324s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9b2b0233-e6b0-4857-9000-5769a10ba24d tempest-VolumesTransfersV355Test-1641023739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9b2b0233-e6b0-4857-9000-5769a10ba24d tempest-VolumesTransfersV355Test-1641023739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9b2b0233-e6b0-4857-9000-5769a10ba24d tempest-VolumesTransfersV355Test-1641023739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9b2b0233-e6b0-4857-9000-5769a10ba24d tempest-VolumesTransfersV355Test-1641023739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9b2b0233-e6b0-4857-9000-5769a10ba24d tempest-VolumesTransfersV355Test-1641023739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9b2b0233-e6b0-4857-9000-5769a10ba24d tempest-VolumesTransfersV355Test-1641023739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:07 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:23:07 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:07 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4b7ba08c-e1ad-493f-b9f8-c165f522dc4b 1073741824" returned: 0 in 0.673s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4b7ba08c-e1ad-493f-b9f8-c165f522dc4b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:07 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9b2b0233-e6b0-4857-9000-5769a10ba24d tempest-VolumesTransfersV355Test-1641023739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.317s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-9b2b0233-e6b0-4857-9000-5769a10ba24d tempest-VolumesTransfersV355Test-1641023739 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:07 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4b7ba08c-e1ad-493f-b9f8-c165f522dc4b Sep 28 17:23:07 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:07 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-9b2b0233-e6b0-4857-9000-5769a10ba24d tempest-VolumesTransfersV355Test-1641023739 None] Deleted volume successfully. Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9b2b0233-e6b0-4857-9000-5769a10ba24d tempest-VolumesTransfersV355Test-1641023739 None] Lock "cinder-e20588dc-3a23-409f-b613-7b3a35363dac-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:07 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4b7ba08c-e1ad-493f-b9f8-c165f522dc4b" returned: 0 in 0.297s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.933s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1261722511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c2f9af1-c5e0-4dd7-a864-b165c3011467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c00cbdde2c4958ada36e646125a61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:06Z,use_quota=True,user_id='b425589323c6421189a13067a621d590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Creating volume 7c2f9af1-c5e0-4dd7-a864-b165c3011467 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:07 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7c2f9af1-c5e0-4dd7-a864-b165c3011467 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:07 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7c2f9af1-c5e0-4dd7-a864-b165c3011467 1073741824 Sep 28 17:23:07 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f090e4cd-5c61-40c4-9925-e9fc6eb5576f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b7ba08c-e1ad-493f-b9f8-c165f522dc4b', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5303cc-88b9-47ec-8449-3dbefa14f80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:07 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Volume volume-4b7ba08c-e1ad-493f-b9f8-c165f522dc4b (4b7ba08c-e1ad-493f-b9f8-c165f522dc4b): created successfully Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5303cc-88b9-47ec-8449-3dbefa14f80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Flow 'volume_create_manager' (343613f8-20c3-46c4-aab0-029b252902f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:07 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e0f09263-3116-42c2-a3e2-7716b23b07cc tempest-CreateVolumesFromSnapshotTest-1709753946 None] Created volume successfully. Sep 28 17:23:07 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Flow 'volume_create_manager' (a57635a1-2d2d-45e3-804f-e73245b6451d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0ad64d-b75a-48f3-8791-5a2cb88a15e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0ad64d-b75a-48f3-8791-5a2cb88a15e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2108102307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e55b13c-2d03-4a3d-b72f-3aca321e8c94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3a4bb85ba647fe91b1265d5a0af568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:08Z,use_quota=True,user_id='aa1dda6563f24d0d886e3c1084c7e17f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07be64f-c702-4ead-b4cb-cbb717f4defa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07be64f-c702-4ead-b4cb-cbb717f4defa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6183c010-6ef4-4c49-a498-961d54d45dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6183c010-6ef4-4c49-a498-961d54d45dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e55b13c-2d03-4a3d-b72f-3aca321e8c94', 'volume_name': 'volume-5e55b13c-2d03-4a3d-b72f-3aca321e8c94', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2025857-dc1f-40ec-8297-8b2ec3465b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2025857-dc1f-40ec-8297-8b2ec3465b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99ca9bb-f17b-4450-86ae-d921ead2c760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:08 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Volume 5e55b13c-2d03-4a3d-b72f-3aca321e8c94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e55b13c-2d03-4a3d-b72f-3aca321e8c94', 'volume_size': 1} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:08 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7c2f9af1-c5e0-4dd7-a864-b165c3011467 1073741824" returned: 0 in 0.553s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7c2f9af1-c5e0-4dd7-a864-b165c3011467 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:08 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7c2f9af1-c5e0-4dd7-a864-b165c3011467 Sep 28 17:23:08 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:08 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7c2f9af1-c5e0-4dd7-a864-b165c3011467" returned: 0 in 0.278s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.591s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2108102307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e55b13c-2d03-4a3d-b72f-3aca321e8c94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3a4bb85ba647fe91b1265d5a0af568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:08Z,use_quota=True,user_id='aa1dda6563f24d0d886e3c1084c7e17f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Creating volume 5e55b13c-2d03-4a3d-b72f-3aca321e8c94 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:08 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5e55b13c-2d03-4a3d-b72f-3aca321e8c94 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (992f06e0-1359-4fd7-a8db-7992bf10a514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c2f9af1-c5e0-4dd7-a864-b165c3011467', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:08 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5e55b13c-2d03-4a3d-b72f-3aca321e8c94 1073741824 Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fedbc3ee-985a-4790-99dc-c3d2169bca57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:08 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:08 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Volume volume-7c2f9af1-c5e0-4dd7-a864-b165c3011467 (7c2f9af1-c5e0-4dd7-a864-b165c3011467): created successfully Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fedbc3ee-985a-4790-99dc-c3d2169bca57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Flow 'volume_create_manager' (f613e8df-a2cf-4d60-9b4f-f16ef0fb685f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:08 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-90670dd2-b3a3-4fb2-8025-714a6c392b37 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Created volume successfully. Sep 28 17:23:09 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5e55b13c-2d03-4a3d-b72f-3aca321e8c94 1073741824" returned: 0 in 0.480s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5e55b13c-2d03-4a3d-b72f-3aca321e8c94 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:09 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5e55b13c-2d03-4a3d-b72f-3aca321e8c94 Sep 28 17:23:09 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a9c1f350-afff-4b74-ae2c-cbae2554d1be tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "cinder-7c2f9af1-c5e0-4dd7-a864-b165c3011467-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a9c1f350-afff-4b74-ae2c-cbae2554d1be tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-7c2f9af1-c5e0-4dd7-a864-b165c3011467-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a9c1f350-afff-4b74-ae2c-cbae2554d1be tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "cinder-quobyte-7c2f9af1-c5e0-4dd7-a864-b165c3011467" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a9c1f350-afff-4b74-ae2c-cbae2554d1be tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-quobyte-7c2f9af1-c5e0-4dd7-a864-b165c3011467" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:09 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb42a48-7904-45fd-b95a-dad253a35127]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a9c1f350-afff-4b74-ae2c-cbae2554d1be tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7c2f9af1-c5e0-4dd7-a864-b165c3011467 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:09 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5e55b13c-2d03-4a3d-b72f-3aca321e8c94" returned: 0 in 0.374s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99ca9bb-f17b-4450-86ae-d921ead2c760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e55b13c-2d03-4a3d-b72f-3aca321e8c94', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d55f4819-b6a3-4a81-b786-94973dba054f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:09 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7c2f9af1-c5e0-4dd7-a864-b165c3011467 Sep 28 17:23:09 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:09 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Volume volume-5e55b13c-2d03-4a3d-b72f-3aca321e8c94 (5e55b13c-2d03-4a3d-b72f-3aca321e8c94): created successfully Sep 28 17:23:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d55f4819-b6a3-4a81-b786-94973dba054f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Flow 'volume_create_manager' (a57635a1-2d2d-45e3-804f-e73245b6451d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:09 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-80d254e8-19d2-4828-a62e-0e1ad066cf68 tempest-VolumesTransfersV355Test-1664800179 None] Created volume successfully. Sep 28 17:23:09 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a9c1f350-afff-4b74-ae2c-cbae2554d1be tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7c2f9af1-c5e0-4dd7-a864-b165c3011467" returned: 0 in 0.450s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a9c1f350-afff-4b74-ae2c-cbae2554d1be tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7c2f9af1-c5e0-4dd7-a864-b165c3011467 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:09 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7c2f9af1-c5e0-4dd7-a864-b165c3011467 Sep 28 17:23:09 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:10 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a9c1f350-afff-4b74-ae2c-cbae2554d1be tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7c2f9af1-c5e0-4dd7-a864-b165c3011467" returned: 0 in 0.370s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a9c1f350-afff-4b74-ae2c-cbae2554d1be tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-quobyte-7c2f9af1-c5e0-4dd7-a864-b165c3011467" released by "delete_volume" :: held 0.882s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-a9c1f350-afff-4b74-ae2c-cbae2554d1be tempest-CreateVolumesFromSnapshotTest-1709753946 None] Created reservations ['d94cec24-06f3-4651-bcd8-576a5adef282', '3bba00f0-2751-4c90-899c-8537b6760cc8', '5063de38-2b66-4666-a12c-32ecd71e091e', 'b3ccf61e-37a5-4b5b-b984-86d0fcd6bb1a'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-6320c726-db22-4e9d-8a22-7b67e1ee4f45 tempest-VolumesTransfersV355Test-1641023739 None] Acquiring lock "cinder-5e55b13c-2d03-4a3d-b72f-3aca321e8c94-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a9c1f350-afff-4b74-ae2c-cbae2554d1be tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a9c1f350-afff-4b74-ae2c-cbae2554d1be tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a9c1f350-afff-4b74-ae2c-cbae2554d1be tempest-CreateVolumesFromSnapshotTest-1709753946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a9c1f350-afff-4b74-ae2c-cbae2554d1be tempest-CreateVolumesFromSnapshotTest-1709753946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a9c1f350-afff-4b74-ae2c-cbae2554d1be tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a9c1f350-afff-4b74-ae2c-cbae2554d1be tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d1531cff-6a6e-422c-b6b8-e0d1684092df tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "cinder-4b7ba08c-e1ad-493f-b9f8-c165f522dc4b-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:10 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-6320c726-db22-4e9d-8a22-7b67e1ee4f45 tempest-VolumesTransfersV355Test-1641023739 None] Lock "cinder-5e55b13c-2d03-4a3d-b72f-3aca321e8c94-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:10 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d1531cff-6a6e-422c-b6b8-e0d1684092df tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-4b7ba08c-e1ad-493f-b9f8-c165f522dc4b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-6320c726-db22-4e9d-8a22-7b67e1ee4f45 tempest-VolumesTransfersV355Test-1641023739 None] Acquiring lock "cinder-quobyte-5e55b13c-2d03-4a3d-b72f-3aca321e8c94" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d1531cff-6a6e-422c-b6b8-e0d1684092df tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "cinder-quobyte-4b7ba08c-e1ad-493f-b9f8-c165f522dc4b" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-6320c726-db22-4e9d-8a22-7b67e1ee4f45 tempest-VolumesTransfersV355Test-1641023739 None] Lock "cinder-quobyte-5e55b13c-2d03-4a3d-b72f-3aca321e8c94" acquired by "delete_volume" :: waited 0.044s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d1531cff-6a6e-422c-b6b8-e0d1684092df tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-quobyte-4b7ba08c-e1ad-493f-b9f8-c165f522dc4b" acquired by "delete_volume" :: waited 0.062s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[09db8f32-40e3-4c58-bd15-e8e04f8560ad]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6320c726-db22-4e9d-8a22-7b67e1ee4f45 tempest-VolumesTransfersV355Test-1641023739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5e55b13c-2d03-4a3d-b72f-3aca321e8c94 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e093b5da-e4d3-411c-91cb-a54971a514b1]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d1531cff-6a6e-422c-b6b8-e0d1684092df tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4b7ba08c-e1ad-493f-b9f8-c165f522dc4b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:10 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a9c1f350-afff-4b74-ae2c-cbae2554d1be tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.394s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:10 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-a9c1f350-afff-4b74-ae2c-cbae2554d1be tempest-CreateVolumesFromSnapshotTest-1709753946 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:10 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a9c1f350-afff-4b74-ae2c-cbae2554d1be tempest-CreateVolumesFromSnapshotTest-1709753946 None] Deleted volume successfully. Sep 28 17:23:10 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4b7ba08c-e1ad-493f-b9f8-c165f522dc4b Sep 28 17:23:10 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a9c1f350-afff-4b74-ae2c-cbae2554d1be tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-7c2f9af1-c5e0-4dd7-a864-b165c3011467-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:11 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5e55b13c-2d03-4a3d-b72f-3aca321e8c94 Sep 28 17:23:11 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:11 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6320c726-db22-4e9d-8a22-7b67e1ee4f45 tempest-VolumesTransfersV355Test-1641023739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5e55b13c-2d03-4a3d-b72f-3aca321e8c94" returned: 0 in 0.530s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6320c726-db22-4e9d-8a22-7b67e1ee4f45 tempest-VolumesTransfersV355Test-1641023739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5e55b13c-2d03-4a3d-b72f-3aca321e8c94 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:11 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5e55b13c-2d03-4a3d-b72f-3aca321e8c94 Sep 28 17:23:11 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:11 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d1531cff-6a6e-422c-b6b8-e0d1684092df tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4b7ba08c-e1ad-493f-b9f8-c165f522dc4b" returned: 0 in 0.565s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d1531cff-6a6e-422c-b6b8-e0d1684092df tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4b7ba08c-e1ad-493f-b9f8-c165f522dc4b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:11 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4b7ba08c-e1ad-493f-b9f8-c165f522dc4b Sep 28 17:23:11 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:11 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6320c726-db22-4e9d-8a22-7b67e1ee4f45 tempest-VolumesTransfersV355Test-1641023739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5e55b13c-2d03-4a3d-b72f-3aca321e8c94" returned: 0 in 0.351s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-6320c726-db22-4e9d-8a22-7b67e1ee4f45 tempest-VolumesTransfersV355Test-1641023739 None] Lock "cinder-quobyte-5e55b13c-2d03-4a3d-b72f-3aca321e8c94" released by "delete_volume" :: held 0.957s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:11 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d1531cff-6a6e-422c-b6b8-e0d1684092df tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4b7ba08c-e1ad-493f-b9f8-c165f522dc4b" returned: 0 in 0.332s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d1531cff-6a6e-422c-b6b8-e0d1684092df tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-quobyte-4b7ba08c-e1ad-493f-b9f8-c165f522dc4b" released by "delete_volume" :: held 0.975s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:11 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-6320c726-db22-4e9d-8a22-7b67e1ee4f45 tempest-VolumesTransfersV355Test-1641023739 None] Created reservations ['fa73857b-7649-4074-926d-bb9569660ea5', '80b3150d-0294-4a93-9a2b-11dae28d2d09', '636eeeb0-fa83-440d-acc5-18eecd59740f', '290e932f-586f-4d60-a741-93d9d212cdaf'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:11 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-d1531cff-6a6e-422c-b6b8-e0d1684092df tempest-CreateVolumesFromSnapshotTest-1709753946 None] Created reservations ['3b29151d-d1dc-4c11-95a5-75171d993235', '6e7eacb2-5e9d-43d8-b448-b4621de62783', 'cf1f2094-920b-4371-bca3-15372c06d5d5', 'a2adbc4b-dcda-412c-afbb-cc517ab7cf6b'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-6320c726-db22-4e9d-8a22-7b67e1ee4f45 tempest-VolumesTransfersV355Test-1641023739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-6320c726-db22-4e9d-8a22-7b67e1ee4f45 tempest-VolumesTransfersV355Test-1641023739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-6320c726-db22-4e9d-8a22-7b67e1ee4f45 tempest-VolumesTransfersV355Test-1641023739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-6320c726-db22-4e9d-8a22-7b67e1ee4f45 tempest-VolumesTransfersV355Test-1641023739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-6320c726-db22-4e9d-8a22-7b67e1ee4f45 tempest-VolumesTransfersV355Test-1641023739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6320c726-db22-4e9d-8a22-7b67e1ee4f45 tempest-VolumesTransfersV355Test-1641023739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:11 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:23:11 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d1531cff-6a6e-422c-b6b8-e0d1684092df tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d1531cff-6a6e-422c-b6b8-e0d1684092df tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d1531cff-6a6e-422c-b6b8-e0d1684092df tempest-CreateVolumesFromSnapshotTest-1709753946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d1531cff-6a6e-422c-b6b8-e0d1684092df tempest-CreateVolumesFromSnapshotTest-1709753946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d1531cff-6a6e-422c-b6b8-e0d1684092df tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d1531cff-6a6e-422c-b6b8-e0d1684092df tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:12 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:23:12 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:12 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6320c726-db22-4e9d-8a22-7b67e1ee4f45 tempest-VolumesTransfersV355Test-1641023739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.321s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:12 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-6320c726-db22-4e9d-8a22-7b67e1ee4f45 tempest-VolumesTransfersV355Test-1641023739 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:12 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-6320c726-db22-4e9d-8a22-7b67e1ee4f45 tempest-VolumesTransfersV355Test-1641023739 None] Deleted volume successfully. Sep 28 17:23:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-6320c726-db22-4e9d-8a22-7b67e1ee4f45 tempest-VolumesTransfersV355Test-1641023739 None] Lock "cinder-5e55b13c-2d03-4a3d-b72f-3aca321e8c94-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:12 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d1531cff-6a6e-422c-b6b8-e0d1684092df tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.346s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:12 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-d1531cff-6a6e-422c-b6b8-e0d1684092df tempest-CreateVolumesFromSnapshotTest-1709753946 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:12 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d1531cff-6a6e-422c-b6b8-e0d1684092df tempest-CreateVolumesFromSnapshotTest-1709753946 None] Deleted volume successfully. Sep 28 17:23:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d1531cff-6a6e-422c-b6b8-e0d1684092df tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-4b7ba08c-e1ad-493f-b9f8-c165f522dc4b-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8879c3bc-33db-4d31-8a55-8eb3bbc61958 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "cinder-7ddbc09b-1878-441c-a82e-78dfabb737c3-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8879c3bc-33db-4d31-8a55-8eb3bbc61958 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-7ddbc09b-1878-441c-a82e-78dfabb737c3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8879c3bc-33db-4d31-8a55-8eb3bbc61958 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "cinder-quobyte-7ddbc09b-1878-441c-a82e-78dfabb737c3" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8879c3bc-33db-4d31-8a55-8eb3bbc61958 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-quobyte-7ddbc09b-1878-441c-a82e-78dfabb737c3" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:13 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b84523-16fc-441e-b11a-7e1601dad7f9]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8879c3bc-33db-4d31-8a55-8eb3bbc61958 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ddbc09b-1878-441c-a82e-78dfabb737c3 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:13 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ddbc09b-1878-441c-a82e-78dfabb737c3 Sep 28 17:23:13 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:13 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8879c3bc-33db-4d31-8a55-8eb3bbc61958 tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ddbc09b-1878-441c-a82e-78dfabb737c3" returned: 0 in 0.461s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8879c3bc-33db-4d31-8a55-8eb3bbc61958 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ddbc09b-1878-441c-a82e-78dfabb737c3 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:13 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ddbc09b-1878-441c-a82e-78dfabb737c3 Sep 28 17:23:13 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:13 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8879c3bc-33db-4d31-8a55-8eb3bbc61958 tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7ddbc09b-1878-441c-a82e-78dfabb737c3" returned: 0 in 0.314s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8879c3bc-33db-4d31-8a55-8eb3bbc61958 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-quobyte-7ddbc09b-1878-441c-a82e-78dfabb737c3" released by "delete_volume" :: held 0.840s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:13 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-8879c3bc-33db-4d31-8a55-8eb3bbc61958 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Created reservations ['828069f8-73df-4015-bc38-11fab496ebad', '8439a40e-237b-4f85-920c-adfc3f8553ef', '2eb8718e-2ce0-4a9a-b294-9de02d24cbfd', 'c5aff775-287f-4e6c-b5e0-cc56aff885b4'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8879c3bc-33db-4d31-8a55-8eb3bbc61958 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8879c3bc-33db-4d31-8a55-8eb3bbc61958 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:14 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8879c3bc-33db-4d31-8a55-8eb3bbc61958 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:14 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8879c3bc-33db-4d31-8a55-8eb3bbc61958 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8879c3bc-33db-4d31-8a55-8eb3bbc61958 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8879c3bc-33db-4d31-8a55-8eb3bbc61958 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:14 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:23:14 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5ab51801-d32f-4139-846c-9409ece0e9b5 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "cinder-81c1781b-618b-46da-8488-6b5ebdc31928-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5ab51801-d32f-4139-846c-9409ece0e9b5 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-81c1781b-618b-46da-8488-6b5ebdc31928-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5ab51801-d32f-4139-846c-9409ece0e9b5 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "cinder-quobyte-81c1781b-618b-46da-8488-6b5ebdc31928" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5ab51801-d32f-4139-846c-9409ece0e9b5 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-quobyte-81c1781b-618b-46da-8488-6b5ebdc31928" acquired by "delete_volume" :: waited 0.025s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:14 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[2463dc1e-207d-4956-a00e-24aad09f7b73]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ab51801-d32f-4139-846c-9409ece0e9b5 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-81c1781b-618b-46da-8488-6b5ebdc31928 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:14 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8879c3bc-33db-4d31-8a55-8eb3bbc61958 tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.447s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:14 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-8879c3bc-33db-4d31-8a55-8eb3bbc61958 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:14 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-8879c3bc-33db-4d31-8a55-8eb3bbc61958 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Deleted volume successfully. Sep 28 17:23:14 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-81c1781b-618b-46da-8488-6b5ebdc31928 Sep 28 17:23:14 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8879c3bc-33db-4d31-8a55-8eb3bbc61958 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-7ddbc09b-1878-441c-a82e-78dfabb737c3-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:14 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ab51801-d32f-4139-846c-9409ece0e9b5 tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-81c1781b-618b-46da-8488-6b5ebdc31928" returned: 0 in 0.553s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ab51801-d32f-4139-846c-9409ece0e9b5 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-81c1781b-618b-46da-8488-6b5ebdc31928 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:15 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-81c1781b-618b-46da-8488-6b5ebdc31928 Sep 28 17:23:15 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:15 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ab51801-d32f-4139-846c-9409ece0e9b5 tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-81c1781b-618b-46da-8488-6b5ebdc31928" returned: 0 in 0.415s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5ab51801-d32f-4139-846c-9409ece0e9b5 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-quobyte-81c1781b-618b-46da-8488-6b5ebdc31928" released by "delete_volume" :: held 1.045s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:15 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-5ab51801-d32f-4139-846c-9409ece0e9b5 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Created reservations ['e1b5c970-f51c-459f-a33b-75b13f37a661', 'dda9ba6e-a155-4312-bd08-3cdf4b690cdb', 'ae04de82-ae4a-4377-9735-19869a7f3a7b', '406f8470-64be-4d86-bae2-c57bd289026e'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5ab51801-d32f-4139-846c-9409ece0e9b5 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5ab51801-d32f-4139-846c-9409ece0e9b5 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:15 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-5ab51801-d32f-4139-846c-9409ece0e9b5 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:15 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-5ab51801-d32f-4139-846c-9409ece0e9b5 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5ab51801-d32f-4139-846c-9409ece0e9b5 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ab51801-d32f-4139-846c-9409ece0e9b5 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:15 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:23:15 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:15 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ab51801-d32f-4139-846c-9409ece0e9b5 tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.350s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:15 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-5ab51801-d32f-4139-846c-9409ece0e9b5 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:15 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-5ab51801-d32f-4139-846c-9409ece0e9b5 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Deleted volume successfully. Sep 28 17:23:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5ab51801-d32f-4139-846c-9409ece0e9b5 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-81c1781b-618b-46da-8488-6b5ebdc31928-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e297ae28-268f-4c17-ac0b-e480f32becb4 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "cinder-cde94c9d-c372-473e-8b75-c47d68e5d673-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e297ae28-268f-4c17-ac0b-e480f32becb4 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-cde94c9d-c372-473e-8b75-c47d68e5d673-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e297ae28-268f-4c17-ac0b-e480f32becb4 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "cinder-quobyte-cde94c9d-c372-473e-8b75-c47d68e5d673" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e297ae28-268f-4c17-ac0b-e480f32becb4 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-quobyte-cde94c9d-c372-473e-8b75-c47d68e5d673" acquired by "delete_volume" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:16 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fef77bb-102a-46ca-b9d9-f83c14861429]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e297ae28-268f-4c17-ac0b-e480f32becb4 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cde94c9d-c372-473e-8b75-c47d68e5d673 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:16 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cde94c9d-c372-473e-8b75-c47d68e5d673 Sep 28 17:23:16 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:17 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e297ae28-268f-4c17-ac0b-e480f32becb4 tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cde94c9d-c372-473e-8b75-c47d68e5d673" returned: 0 in 0.510s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e297ae28-268f-4c17-ac0b-e480f32becb4 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cde94c9d-c372-473e-8b75-c47d68e5d673 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:17 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cde94c9d-c372-473e-8b75-c47d68e5d673 Sep 28 17:23:17 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:17 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e297ae28-268f-4c17-ac0b-e480f32becb4 tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cde94c9d-c372-473e-8b75-c47d68e5d673" returned: 0 in 0.270s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e297ae28-268f-4c17-ac0b-e480f32becb4 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-quobyte-cde94c9d-c372-473e-8b75-c47d68e5d673" released by "delete_volume" :: held 0.833s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-e297ae28-268f-4c17-ac0b-e480f32becb4 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Created reservations ['4bdd2b30-6b8e-4532-97df-191ba98ad5d4', 'ff1d2f5b-bf5a-4898-b543-0ab00ac5eb53', '1857dbeb-3656-43c2-b64d-53a7308ddca2', '2bcb4fe3-ca6b-4f53-b312-9d139c590783'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e297ae28-268f-4c17-ac0b-e480f32becb4 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e297ae28-268f-4c17-ac0b-e480f32becb4 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e297ae28-268f-4c17-ac0b-e480f32becb4 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e297ae28-268f-4c17-ac0b-e480f32becb4 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e297ae28-268f-4c17-ac0b-e480f32becb4 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e297ae28-268f-4c17-ac0b-e480f32becb4 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:17 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:23:17 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ea621a7d-842d-4602-a786-96a5f0783abf tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "cinder-82db1b93-3639-4705-bf63-ba02e3343484-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ea621a7d-842d-4602-a786-96a5f0783abf tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-82db1b93-3639-4705-bf63-ba02e3343484-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ea621a7d-842d-4602-a786-96a5f0783abf tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "cinder-quobyte-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ea621a7d-842d-4602-a786-96a5f0783abf tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-quobyte-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ea621a7d-842d-4602-a786-96a5f0783abf tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "cinder-quobyte-82db1b93-3639-4705-bf63-ba02e3343484" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ea621a7d-842d-4602-a786-96a5f0783abf tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-quobyte-82db1b93-3639-4705-bf63-ba02e3343484" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-ea621a7d-842d-4602-a786-96a5f0783abf tempest-CreateVolumesFromSnapshotTest-1709753946 None] Deleting offline snapshot 82db1b93-3639-4705-bf63-ba02e3343484 of volume 5cd86d06-0b44-4ffd-bb2c-890701e5a0f2 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-ea621a7d-842d-4602-a786-96a5f0783abf tempest-CreateVolumesFromSnapshotTest-1709753946 None] snapshot_file for this snap is: volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.82db1b93-3639-4705-bf63-ba02e3343484 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b2fed0-1612-42bf-b58a-ab9c303b0ee4]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ea621a7d-842d-4602-a786-96a5f0783abf tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.82db1b93-3639-4705-bf63-ba02e3343484 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:17 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e297ae28-268f-4c17-ac0b-e480f32becb4 tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.351s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:17 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-e297ae28-268f-4c17-ac0b-e480f32becb4 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:17 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e297ae28-268f-4c17-ac0b-e480f32becb4 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Deleted volume successfully. Sep 28 17:23:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e297ae28-268f-4c17-ac0b-e480f32becb4 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-cde94c9d-c372-473e-8b75-c47d68e5d673-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:18 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.82db1b93-3639-4705-bf63-ba02e3343484 Sep 28 17:23:18 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:18 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ea621a7d-842d-4602-a786-96a5f0783abf tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.82db1b93-3639-4705-bf63-ba02e3343484" returned: 0 in 0.472s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:18 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-ea621a7d-842d-4602-a786-96a5f0783abf tempest-CreateVolumesFromSnapshotTest-1709753946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:23:18 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d030223-4488-4d5e-8451-fdcefbcaf6c4]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ea621a7d-842d-4602-a786-96a5f0783abf tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:18 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2 Sep 28 17:23:18 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:18 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ea621a7d-842d-4602-a786-96a5f0783abf tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2" returned: 0 in 0.439s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ea621a7d-842d-4602-a786-96a5f0783abf tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.82db1b93-3639-4705-bf63-ba02e3343484 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:18 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.82db1b93-3639-4705-bf63-ba02e3343484 Sep 28 17:23:18 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:19 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ea621a7d-842d-4602-a786-96a5f0783abf tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.82db1b93-3639-4705-bf63-ba02e3343484" returned: 0 in 0.392s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ea621a7d-842d-4602-a786-96a5f0783abf tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.82db1b93-3639-4705-bf63-ba02e3343484 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:19 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.82db1b93-3639-4705-bf63-ba02e3343484 Sep 28 17:23:19 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:19 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ea621a7d-842d-4602-a786-96a5f0783abf tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2.82db1b93-3639-4705-bf63-ba02e3343484" returned: 0 in 0.328s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:19 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ea621a7d-842d-4602-a786-96a5f0783abf tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-quobyte-82db1b93-3639-4705-bf63-ba02e3343484" released by "_delete_snapshot" :: held 1.816s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:19 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ea621a7d-842d-4602-a786-96a5f0783abf tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-quobyte-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2" released by "delete_snapshot" :: held 1.855s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:19 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-ea621a7d-842d-4602-a786-96a5f0783abf tempest-CreateVolumesFromSnapshotTest-1709753946 None] Created reservations ['4493c790-0ff7-499b-98d2-03dba28e9815', '5c3c646d-19ed-43c1-b2fc-2b5588d7e573', '96a1f686-ce53-4329-92cf-62cf706854c0', '17bee80e-d3a6-4c28-b031-07dc53975304'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:19 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-ea621a7d-842d-4602-a786-96a5f0783abf tempest-CreateVolumesFromSnapshotTest-1709753946 None] Delete snapshot completed successfully. Sep 28 17:23:19 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ea621a7d-842d-4602-a786-96a5f0783abf tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-82db1b93-3639-4705-bf63-ba02e3343484-delete_snapshot" released by "delete_snapshot" :: held 2.053s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:19 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0e954811-2093-497b-83aa-466f867cd124 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "cinder-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:20 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0e954811-2093-497b-83aa-466f867cd124 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:20 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0e954811-2093-497b-83aa-466f867cd124 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "cinder-quobyte-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:20 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0e954811-2093-497b-83aa-466f867cd124 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-quobyte-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2" acquired by "delete_volume" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:20 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29f6d87-d7b0-4145-9c6d-1fe93d0b94c5]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0e954811-2093-497b-83aa-466f867cd124 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:20 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2 Sep 28 17:23:20 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:20 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0e954811-2093-497b-83aa-466f867cd124 tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2" returned: 0 in 0.505s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0e954811-2093-497b-83aa-466f867cd124 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:20 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2 Sep 28 17:23:20 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:21 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0e954811-2093-497b-83aa-466f867cd124 tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2" returned: 0 in 0.367s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0e954811-2093-497b-83aa-466f867cd124 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-quobyte-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2" released by "delete_volume" :: held 0.958s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:21 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-0e954811-2093-497b-83aa-466f867cd124 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Created reservations ['1d7a4480-168f-4b0d-901a-d1b85d451a9c', 'c30f90f5-6fb4-401c-83b5-b39ba9474fc7', '2266baa6-b802-47f0-a0f2-6cf9d77caaa0', 'f81b22cd-0cc6-4a06-a9b0-a80ee176974b'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0e954811-2093-497b-83aa-466f867cd124 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0e954811-2093-497b-83aa-466f867cd124 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:21 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0e954811-2093-497b-83aa-466f867cd124 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:21 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0e954811-2093-497b-83aa-466f867cd124 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0e954811-2093-497b-83aa-466f867cd124 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0e954811-2093-497b-83aa-466f867cd124 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:21 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:23:21 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:21 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0e954811-2093-497b-83aa-466f867cd124 tempest-CreateVolumesFromSnapshotTest-1709753946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.301s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:21 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-0e954811-2093-497b-83aa-466f867cd124 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:21 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-0e954811-2093-497b-83aa-466f867cd124 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Deleted volume successfully. Sep 28 17:23:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0e954811-2093-497b-83aa-466f867cd124 tempest-CreateVolumesFromSnapshotTest-1709753946 None] Lock "cinder-5cd86d06-0b44-4ffd-bb2c-890701e5a0f2-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:25 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Flow 'volume_create_manager' (9fd9db49-7695-4beb-b303-0cf260325be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e2829e5-2905-4c61-8bc1-9da95d925aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e2829e5-2905-4c61-8bc1-9da95d925aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c89cb5-0f70-4741-979b-56f5c5c38556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6d01fe276d4684b9a225e3815d1792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:26Z,use_quota=True,user_id='1b1875cee7664289bf514b524664ccaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ceda82-89d4-44b4-a997-b4e0c4f3c9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ceda82-89d4-44b4-a997-b4e0c4f3c9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7c253a-8814-41a1-8b74-0d34a92df073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7c253a-8814-41a1-8b74-0d34a92df073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6c89cb5-0f70-4741-979b-56f5c5c38556', 'volume_name': 'volume-a6c89cb5-0f70-4741-979b-56f5c5c38556', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df7bf321-114a-418a-ae64-7b83f39b5bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df7bf321-114a-418a-ae64-7b83f39b5bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:25 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45570bf-c9a7-4cfd-9e35-06c5bf806a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:25 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Volume a6c89cb5-0f70-4741-979b-56f5c5c38556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6c89cb5-0f70-4741-979b-56f5c5c38556', 'volume_size': 1} Sep 28 17:23:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:25 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c89cb5-0f70-4741-979b-56f5c5c38556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6d01fe276d4684b9a225e3815d1792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:26Z,use_quota=True,user_id='1b1875cee7664289bf514b524664ccaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:25 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Creating volume a6c89cb5-0f70-4741-979b-56f5c5c38556 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:25 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:25 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:25 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:25 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:23:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6c89cb5-0f70-4741-979b-56f5c5c38556 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:25 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6c89cb5-0f70-4741-979b-56f5c5c38556 1073741824 Sep 28 17:23:25 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:26 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6c89cb5-0f70-4741-979b-56f5c5c38556 1073741824" returned: 0 in 0.541s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6c89cb5-0f70-4741-979b-56f5c5c38556 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:26 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6c89cb5-0f70-4741-979b-56f5c5c38556 Sep 28 17:23:26 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:26 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6c89cb5-0f70-4741-979b-56f5c5c38556" returned: 0 in 0.308s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45570bf-c9a7-4cfd-9e35-06c5bf806a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6c89cb5-0f70-4741-979b-56f5c5c38556', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3f12f3-53d0-4d2c-a4c4-4ccc94c06150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:26 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Volume volume-a6c89cb5-0f70-4741-979b-56f5c5c38556 (a6c89cb5-0f70-4741-979b-56f5c5c38556): created successfully Sep 28 17:23:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3f12f3-53d0-4d2c-a4c4-4ccc94c06150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:26 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Flow 'volume_create_manager' (9fd9db49-7695-4beb-b303-0cf260325be5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:26 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-2d3742b5-cad8-4566-aafb-3f9c9d52e3ea tempest-CinderUnicodeTest-714349145 None] Created volume successfully. Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=86,cinder:UPDATE=133,cinder:INSERT=33,cinder:DELETE=10 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=97,cinder:UPDATE=130,cinder:INSERT=30,cinder:DELETE=12 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Flow 'volume_create_manager' (fdece262-3b90-4dab-b503-2da622de81b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b1aee0-a12e-403d-a8c0-ddab136115a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b1aee0-a12e-403d-a8c0-ddab136115a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1461206224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6d01fe276d4684b9a225e3815d1792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:28Z,use_quota=True,user_id='1b1875cee7664289bf514b524664ccaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d509c84a-812a-41fe-915f-53d18db24ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d509c84a-812a-41fe-915f-53d18db24ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427657d0-5bd1-45c8-963a-8f7e53d0c8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427657d0-5bd1-45c8-963a-8f7e53d0c8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2', 'volume_name': 'volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798247c0-902c-4ed2-a058-187ca41e4dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798247c0-902c-4ed2-a058-187ca41e4dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cece3ccf-0bfd-412f-8726-4dffea2a28cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:28 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Volume 954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2', 'volume_size': 1} Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1461206224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6d01fe276d4684b9a225e3815d1792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:28Z,use_quota=True,user_id='1b1875cee7664289bf514b524664ccaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Creating volume 954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:28 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:23:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:28 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2 1073741824 Sep 28 17:23:28 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:29 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2 1073741824" returned: 0 in 0.541s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:29 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2 Sep 28 17:23:29 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:29 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2" returned: 0 in 0.308s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cece3ccf-0bfd-412f-8726-4dffea2a28cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc01bf1-f323-4441-9b54-602823dc5d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:29 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Volume volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2 (954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2): created successfully Sep 28 17:23:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc01bf1-f323-4441-9b54-602823dc5d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Flow 'volume_create_manager' (fdece262-3b90-4dab-b503-2da622de81b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:29 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-30f9137d-4e57-438a-a85f-f6155dff8881 tempest-CinderUnicodeTest-714349145 None] Created volume successfully. Sep 28 17:23:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-36ffe6f9-8d4c-4284-bbe3-fa97668a0afb tempest-CinderUnicodeTest-714349145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-36ffe6f9-8d4c-4284-bbe3-fa97668a0afb tempest-CinderUnicodeTest-714349145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:30 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-36ffe6f9-8d4c-4284-bbe3-fa97668a0afb tempest-CinderUnicodeTest-714349145 None] Creating offline snapshot 2fe5f6d6-1349-493d-9835-19eef123f45e of volume 954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:23:30 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33d3e48-a6fc-436d-99b2-c368d712d585]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-36ffe6f9-8d4c-4284-bbe3-fa97668a0afb tempest-CinderUnicodeTest-714349145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:31 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2 Sep 28 17:23:31 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:31 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-36ffe6f9-8d4c-4284-bbe3-fa97668a0afb tempest-CinderUnicodeTest-714349145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2" returned: 0 in 0.472s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-36ffe6f9-8d4c-4284-bbe3-fa97668a0afb tempest-CinderUnicodeTest-714349145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.2fe5f6d6-1349-493d-9835-19eef123f45e 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:31 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.2fe5f6d6-1349-493d-9835-19eef123f45e 1G Sep 28 17:23:31 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:31 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-36ffe6f9-8d4c-4284-bbe3-fa97668a0afb tempest-CinderUnicodeTest-714349145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.2fe5f6d6-1349-493d-9835-19eef123f45e 1G" returned: 0 in 0.619s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-36ffe6f9-8d4c-4284-bbe3-fa97668a0afb tempest-CinderUnicodeTest-714349145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.2fe5f6d6-1349-493d-9835-19eef123f45e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:32 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.2fe5f6d6-1349-493d-9835-19eef123f45e Sep 28 17:23:32 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:32 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-36ffe6f9-8d4c-4284-bbe3-fa97668a0afb tempest-CinderUnicodeTest-714349145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.2fe5f6d6-1349-493d-9835-19eef123f45e" returned: 0 in 0.451s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:32 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-36ffe6f9-8d4c-4284-bbe3-fa97668a0afb tempest-CinderUnicodeTest-714349145 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.2fe5f6d6-1349-493d-9835-19eef123f45e is being set with open permissions: ugo+rw Sep 28 17:23:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-36ffe6f9-8d4c-4284-bbe3-fa97668a0afb tempest-CinderUnicodeTest-714349145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.2fe5f6d6-1349-493d-9835-19eef123f45e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:32 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.2fe5f6d6-1349-493d-9835-19eef123f45e Sep 28 17:23:32 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:32 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-36ffe6f9-8d4c-4284-bbe3-fa97668a0afb tempest-CinderUnicodeTest-714349145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.2fe5f6d6-1349-493d-9835-19eef123f45e" returned: 0 in 0.407s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-36ffe6f9-8d4c-4284-bbe3-fa97668a0afb tempest-CinderUnicodeTest-714349145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:32 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.info Sep 28 17:23:32 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:33 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-36ffe6f9-8d4c-4284-bbe3-fa97668a0afb tempest-CinderUnicodeTest-714349145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.info" returned: 0 in 0.353s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:33 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-36ffe6f9-8d4c-4284-bbe3-fa97668a0afb tempest-CinderUnicodeTest-714349145 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.info is being set with open permissions: ugo+rw Sep 28 17:23:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-36ffe6f9-8d4c-4284-bbe3-fa97668a0afb tempest-CinderUnicodeTest-714349145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:33 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.info Sep 28 17:23:33 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:33 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-36ffe6f9-8d4c-4284-bbe3-fa97668a0afb tempest-CinderUnicodeTest-714349145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.info" returned: 0 in 0.350s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-36ffe6f9-8d4c-4284-bbe3-fa97668a0afb tempest-CinderUnicodeTest-714349145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.792s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:33 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-36ffe6f9-8d4c-4284-bbe3-fa97668a0afb tempest-CinderUnicodeTest-714349145 None] Create snapshot completed successfully Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-df8ec727-5867-47ca-be2a-95986dfd8824 tempest-CinderUnicodeTest-714349145 None] Acquiring lock "cinder-2fe5f6d6-1349-493d-9835-19eef123f45e-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-df8ec727-5867-47ca-be2a-95986dfd8824 tempest-CinderUnicodeTest-714349145 None] Lock "cinder-2fe5f6d6-1349-493d-9835-19eef123f45e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-df8ec727-5867-47ca-be2a-95986dfd8824 tempest-CinderUnicodeTest-714349145 None] Acquiring lock "cinder-quobyte-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-df8ec727-5867-47ca-be2a-95986dfd8824 tempest-CinderUnicodeTest-714349145 None] Lock "cinder-quobyte-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-df8ec727-5867-47ca-be2a-95986dfd8824 tempest-CinderUnicodeTest-714349145 None] Acquiring lock "cinder-quobyte-2fe5f6d6-1349-493d-9835-19eef123f45e" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-df8ec727-5867-47ca-be2a-95986dfd8824 tempest-CinderUnicodeTest-714349145 None] Lock "cinder-quobyte-2fe5f6d6-1349-493d-9835-19eef123f45e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-df8ec727-5867-47ca-be2a-95986dfd8824 tempest-CinderUnicodeTest-714349145 None] Deleting offline snapshot 2fe5f6d6-1349-493d-9835-19eef123f45e of volume 954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-df8ec727-5867-47ca-be2a-95986dfd8824 tempest-CinderUnicodeTest-714349145 None] snapshot_file for this snap is: volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.2fe5f6d6-1349-493d-9835-19eef123f45e {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d7097e-a3a5-44e0-a73e-cd2614be91a1]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df8ec727-5867-47ca-be2a-95986dfd8824 tempest-CinderUnicodeTest-714349145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.2fe5f6d6-1349-493d-9835-19eef123f45e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:34 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.2fe5f6d6-1349-493d-9835-19eef123f45e Sep 28 17:23:34 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:34 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Flow 'volume_create_manager' (24e0f272-42a4-47cc-8614-df95789feca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213b35c0-6cdc-435d-9b1d-f71f013dbc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df8ec727-5867-47ca-be2a-95986dfd8824 tempest-CinderUnicodeTest-714349145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.2fe5f6d6-1349-493d-9835-19eef123f45e" returned: 0 in 0.535s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-df8ec727-5867-47ca-be2a-95986dfd8824 tempest-CinderUnicodeTest-714349145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213b35c0-6cdc-435d-9b1d-f71f013dbc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-492298408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf71b3e7-814a-4215-a74c-299937a36b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94156b69b89d4669b136549ed8986a07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:35Z,use_quota=True,user_id='c8a91f87b2a742cb8fbbc20423243c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ff1898d-6381-4d13-b6e3-7411e715f20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ff1898d-6381-4d13-b6e3-7411e715f20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e23fe7fe-ca4e-4402-ae45-6e190f05363a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e23fe7fe-ca4e-4402-ae45-6e190f05363a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf71b3e7-814a-4215-a74c-299937a36b25', 'volume_name': 'volume-cf71b3e7-814a-4215-a74c-299937a36b25', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a30bf4-eee7-4def-98d7-97a09255261d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a30bf4-eee7-4def-98d7-97a09255261d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c7c725-86e5-44e8-83d5-c3d20824a3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:34 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Volume cf71b3e7-814a-4215-a74c-299937a36b25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf71b3e7-814a-4215-a74c-299937a36b25', 'volume_size': 1} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-492298408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf71b3e7-814a-4215-a74c-299937a36b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94156b69b89d4669b136549ed8986a07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:35Z,use_quota=True,user_id='c8a91f87b2a742cb8fbbc20423243c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Creating volume cf71b3e7-814a-4215-a74c-299937a36b25 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:34 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9112c1-3f7a-4499-9609-6b04511d82ab]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df8ec727-5867-47ca-be2a-95986dfd8824 tempest-CinderUnicodeTest-714349145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:34 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 1073741824 Sep 28 17:23:34 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:34 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2 Sep 28 17:23:34 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:35 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df8ec727-5867-47ca-be2a-95986dfd8824 tempest-CinderUnicodeTest-714349145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2" returned: 0 in 0.463s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df8ec727-5867-47ca-be2a-95986dfd8824 tempest-CinderUnicodeTest-714349145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.2fe5f6d6-1349-493d-9835-19eef123f45e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:35 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.2fe5f6d6-1349-493d-9835-19eef123f45e Sep 28 17:23:35 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:35 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 1073741824" returned: 0 in 0.606s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:35 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 Sep 28 17:23:35 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:35 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df8ec727-5867-47ca-be2a-95986dfd8824 tempest-CinderUnicodeTest-714349145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.2fe5f6d6-1349-493d-9835-19eef123f45e" returned: 0 in 0.452s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df8ec727-5867-47ca-be2a-95986dfd8824 tempest-CinderUnicodeTest-714349145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.2fe5f6d6-1349-493d-9835-19eef123f45e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:35 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.2fe5f6d6-1349-493d-9835-19eef123f45e Sep 28 17:23:35 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:35 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25" returned: 0 in 0.324s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c7c725-86e5-44e8-83d5-c3d20824a3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf71b3e7-814a-4215-a74c-299937a36b25', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (283e46df-a6e3-4908-8692-dea6dc091108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:35 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Volume volume-cf71b3e7-814a-4215-a74c-299937a36b25 (cf71b3e7-814a-4215-a74c-299937a36b25): created successfully Sep 28 17:23:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (283e46df-a6e3-4908-8692-dea6dc091108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Flow 'volume_create_manager' (24e0f272-42a4-47cc-8614-df95789feca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:35 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-3dc4e8ba-17d4-4802-8cf7-39c25f2d0bec tempest-VolumesActionsTest-1575556531 None] Created volume successfully. Sep 28 17:23:36 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df8ec727-5867-47ca-be2a-95986dfd8824 tempest-CinderUnicodeTest-714349145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2.2fe5f6d6-1349-493d-9835-19eef123f45e" returned: 0 in 0.356s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-df8ec727-5867-47ca-be2a-95986dfd8824 tempest-CinderUnicodeTest-714349145 None] Lock "cinder-quobyte-2fe5f6d6-1349-493d-9835-19eef123f45e" released by "_delete_snapshot" :: held 2.001s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-df8ec727-5867-47ca-be2a-95986dfd8824 tempest-CinderUnicodeTest-714349145 None] Lock "cinder-quobyte-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2" released by "delete_snapshot" :: held 2.026s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:36 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-df8ec727-5867-47ca-be2a-95986dfd8824 tempest-CinderUnicodeTest-714349145 None] Created reservations ['2ff4444c-df90-48e2-b4a2-db22da10ec7d', 'd3f055ef-1b1e-45e2-b96f-5fd59e415dc6', '477f0329-f540-4767-b6c3-777fe7d4b211', '9fba380f-836d-4059-9df1-0c29948ced43'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:36 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-df8ec727-5867-47ca-be2a-95986dfd8824 tempest-CinderUnicodeTest-714349145 None] Delete snapshot completed successfully. Sep 28 17:23:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-df8ec727-5867-47ca-be2a-95986dfd8824 tempest-CinderUnicodeTest-714349145 None] Lock "cinder-2fe5f6d6-1349-493d-9835-19eef123f45e-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-626db66c-57ae-4e7b-ac19-0d7785c4b036 tempest-CinderUnicodeTest-714349145 None] Acquiring lock "cinder-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-626db66c-57ae-4e7b-ac19-0d7785c4b036 tempest-CinderUnicodeTest-714349145 None] Lock "cinder-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-626db66c-57ae-4e7b-ac19-0d7785c4b036 tempest-CinderUnicodeTest-714349145 None] Acquiring lock "cinder-quobyte-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-626db66c-57ae-4e7b-ac19-0d7785c4b036 tempest-CinderUnicodeTest-714349145 None] Lock "cinder-quobyte-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:37 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a912e9-d3c6-4f3a-babf-bf8a51314b0c]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-626db66c-57ae-4e7b-ac19-0d7785c4b036 tempest-CinderUnicodeTest-714349145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:37 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2 Sep 28 17:23:37 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:37 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-626db66c-57ae-4e7b-ac19-0d7785c4b036 tempest-CinderUnicodeTest-714349145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2" returned: 0 in 0.412s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-626db66c-57ae-4e7b-ac19-0d7785c4b036 tempest-CinderUnicodeTest-714349145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:37 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2 Sep 28 17:23:37 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:38 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-626db66c-57ae-4e7b-ac19-0d7785c4b036 tempest-CinderUnicodeTest-714349145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2" returned: 0 in 0.281s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-626db66c-57ae-4e7b-ac19-0d7785c4b036 tempest-CinderUnicodeTest-714349145 None] Lock "cinder-quobyte-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2" released by "delete_volume" :: held 0.788s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:38 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-626db66c-57ae-4e7b-ac19-0d7785c4b036 tempest-CinderUnicodeTest-714349145 None] Created reservations ['f792ec67-ce06-490d-9957-e844044fbbfc', '91304d9a-e5d1-42d0-905d-d06019b7195c', 'be31b61f-34ec-4a10-86e3-b25426b766e2', '116fdb00-c11c-4f4f-b824-d003cdcfd350'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-626db66c-57ae-4e7b-ac19-0d7785c4b036 tempest-CinderUnicodeTest-714349145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-626db66c-57ae-4e7b-ac19-0d7785c4b036 tempest-CinderUnicodeTest-714349145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-626db66c-57ae-4e7b-ac19-0d7785c4b036 tempest-CinderUnicodeTest-714349145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-626db66c-57ae-4e7b-ac19-0d7785c4b036 tempest-CinderUnicodeTest-714349145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-626db66c-57ae-4e7b-ac19-0d7785c4b036 tempest-CinderUnicodeTest-714349145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-626db66c-57ae-4e7b-ac19-0d7785c4b036 tempest-CinderUnicodeTest-714349145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:38 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:23:38 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0febb796-64e8-45a1-adc2-0692d7736abe tempest-CinderUnicodeTest-714349145 None] Acquiring lock "cinder-a6c89cb5-0f70-4741-979b-56f5c5c38556-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0febb796-64e8-45a1-adc2-0692d7736abe tempest-CinderUnicodeTest-714349145 None] Lock "cinder-a6c89cb5-0f70-4741-979b-56f5c5c38556-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0febb796-64e8-45a1-adc2-0692d7736abe tempest-CinderUnicodeTest-714349145 None] Acquiring lock "cinder-quobyte-a6c89cb5-0f70-4741-979b-56f5c5c38556" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0febb796-64e8-45a1-adc2-0692d7736abe tempest-CinderUnicodeTest-714349145 None] Lock "cinder-quobyte-a6c89cb5-0f70-4741-979b-56f5c5c38556" acquired by "delete_volume" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:38 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-626db66c-57ae-4e7b-ac19-0d7785c4b036 tempest-CinderUnicodeTest-714349145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.372s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:38 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-626db66c-57ae-4e7b-ac19-0d7785c4b036 tempest-CinderUnicodeTest-714349145 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:38 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[741fd245-3656-4aa1-96e0-79bd4177c9a7]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0febb796-64e8-45a1-adc2-0692d7736abe tempest-CinderUnicodeTest-714349145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6c89cb5-0f70-4741-979b-56f5c5c38556 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:38 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-626db66c-57ae-4e7b-ac19-0d7785c4b036 tempest-CinderUnicodeTest-714349145 None] Deleted volume successfully. Sep 28 17:23:38 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-626db66c-57ae-4e7b-ac19-0d7785c4b036 tempest-CinderUnicodeTest-714349145 None] Lock "cinder-954a3784-7ea3-47b5-b5a6-fb1fc7cc3bb2-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:38 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6c89cb5-0f70-4741-979b-56f5c5c38556 Sep 28 17:23:38 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:39 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0febb796-64e8-45a1-adc2-0692d7736abe tempest-CinderUnicodeTest-714349145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6c89cb5-0f70-4741-979b-56f5c5c38556" returned: 0 in 0.509s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0febb796-64e8-45a1-adc2-0692d7736abe tempest-CinderUnicodeTest-714349145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6c89cb5-0f70-4741-979b-56f5c5c38556 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:39 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6c89cb5-0f70-4741-979b-56f5c5c38556 Sep 28 17:23:39 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:39 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0febb796-64e8-45a1-adc2-0692d7736abe tempest-CinderUnicodeTest-714349145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a6c89cb5-0f70-4741-979b-56f5c5c38556" returned: 0 in 0.289s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0febb796-64e8-45a1-adc2-0692d7736abe tempest-CinderUnicodeTest-714349145 None] Lock "cinder-quobyte-a6c89cb5-0f70-4741-979b-56f5c5c38556" released by "delete_volume" :: held 0.879s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:39 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-0febb796-64e8-45a1-adc2-0692d7736abe tempest-CinderUnicodeTest-714349145 None] Created reservations ['e1084d36-1c27-4df6-828a-38fca90068c4', 'fe98524d-15d4-4147-a9c7-7a09d9d9f1fe', 'f29abc92-380d-4781-b910-431d7e6c5920', '38bf87d2-b123-48e7-8c55-9e44f5ea28ad'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0febb796-64e8-45a1-adc2-0692d7736abe tempest-CinderUnicodeTest-714349145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0febb796-64e8-45a1-adc2-0692d7736abe tempest-CinderUnicodeTest-714349145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0febb796-64e8-45a1-adc2-0692d7736abe tempest-CinderUnicodeTest-714349145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0febb796-64e8-45a1-adc2-0692d7736abe tempest-CinderUnicodeTest-714349145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0febb796-64e8-45a1-adc2-0692d7736abe tempest-CinderUnicodeTest-714349145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0febb796-64e8-45a1-adc2-0692d7736abe tempest-CinderUnicodeTest-714349145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:39 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:23:39 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:40 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0febb796-64e8-45a1-adc2-0692d7736abe tempest-CinderUnicodeTest-714349145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.436s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:40 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-0febb796-64e8-45a1-adc2-0692d7736abe tempest-CinderUnicodeTest-714349145 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:40 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-0febb796-64e8-45a1-adc2-0692d7736abe tempest-CinderUnicodeTest-714349145 None] Deleted volume successfully. Sep 28 17:23:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0febb796-64e8-45a1-adc2-0692d7736abe tempest-CinderUnicodeTest-714349145 None] Lock "cinder-a6c89cb5-0f70-4741-979b-56f5c5c38556-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:44 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Flow 'volume_create_manager' (3e158afc-92b7-4a68-865f-5848de4f4656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fd83685-3df4-41fa-b0a8-fd79ee733f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fd83685-3df4-41fa-b0a8-fd79ee733f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2017722074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d860c520-44eb-4d3e-aebc-b91f689ab409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0993cd74d264abdbb25922bc7ddf4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:45Z,use_quota=True,user_id='34367c25bc8c4d51bc5e8089995061fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11ca65d-2db4-4d94-b1c7-24c53309d916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11ca65d-2db4-4d94-b1c7-24c53309d916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbfe6323-715a-481e-89ae-90285c08c8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbfe6323-715a-481e-89ae-90285c08c8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd860c520-44eb-4d3e-aebc-b91f689ab409', 'volume_name': 'volume-d860c520-44eb-4d3e-aebc-b91f689ab409', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948e0278-35c3-4a70-9d20-00033904b5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948e0278-35c3-4a70-9d20-00033904b5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a465afd-9e17-4762-b2dd-65d5de43b624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:45 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Volume d860c520-44eb-4d3e-aebc-b91f689ab409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d860c520-44eb-4d3e-aebc-b91f689ab409', 'volume_size': 1} Sep 28 17:23:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2017722074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d860c520-44eb-4d3e-aebc-b91f689ab409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0993cd74d264abdbb25922bc7ddf4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:45Z,use_quota=True,user_id='34367c25bc8c4d51bc5e8089995061fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Creating volume d860c520-44eb-4d3e-aebc-b91f689ab409 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:45 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:23:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d860c520-44eb-4d3e-aebc-b91f689ab409 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:45 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d860c520-44eb-4d3e-aebc-b91f689ab409 1073741824 Sep 28 17:23:45 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:45 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d860c520-44eb-4d3e-aebc-b91f689ab409 1073741824" returned: 0 in 0.654s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d860c520-44eb-4d3e-aebc-b91f689ab409 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:45 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d860c520-44eb-4d3e-aebc-b91f689ab409 Sep 28 17:23:45 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:46 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d860c520-44eb-4d3e-aebc-b91f689ab409" returned: 0 in 0.344s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a465afd-9e17-4762-b2dd-65d5de43b624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d860c520-44eb-4d3e-aebc-b91f689ab409', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb64b99-34f5-42bc-aaef-31c86f89f6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:46 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Volume volume-d860c520-44eb-4d3e-aebc-b91f689ab409 (d860c520-44eb-4d3e-aebc-b91f689ab409): created successfully Sep 28 17:23:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb64b99-34f5-42bc-aaef-31c86f89f6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Flow 'volume_create_manager' (3e158afc-92b7-4a68-865f-5848de4f4656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:46 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-75cd1a05-16de-4901-a43a-67ae49284826 tempest-ProjectReaderTests-1892409099 None] Created volume successfully. Sep 28 17:23:46 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3468e5b6-5449-4346-80a7-01f63015677e tempest-VolumesActionsTest-1575556531 None] Acquiring lock "cinder-cf71b3e7-814a-4215-a74c-299937a36b25" by "attach_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:46 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3468e5b6-5449-4346-80a7-01f63015677e tempest-VolumesActionsTest-1575556531 None] Lock "cinder-cf71b3e7-814a-4215-a74c-299937a36b25" acquired by "attach_volume" :: waited 0.017s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:46 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-3468e5b6-5449-4346-80a7-01f63015677e tempest-VolumesActionsTest-1575556531 None] Attaching volume cf71b3e7-814a-4215-a74c-299937a36b25 to instance f0c26971-8ca3-4856-8405-5ddd62741390 at mountpoint /dev/vdb on host None. Sep 28 17:23:46 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-3468e5b6-5449-4346-80a7-01f63015677e tempest-VolumesActionsTest-1575556531 None] Attach volume completed successfully. Sep 28 17:23:46 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3468e5b6-5449-4346-80a7-01f63015677e tempest-VolumesActionsTest-1575556531 None] Lock "cinder-cf71b3e7-814a-4215-a74c-299937a36b25" released by "attach_volume" :: held 0.109s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:46 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-51df8741-ddd1-4bcf-8c24-dbb7d5c54116 tempest-VolumesActionsTest-1575556531 None] Acquiring lock "cinder-cf71b3e7-814a-4215-a74c-299937a36b25-detach_volume" by "detach_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:46 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-51df8741-ddd1-4bcf-8c24-dbb7d5c54116 tempest-VolumesActionsTest-1575556531 None] Lock "cinder-cf71b3e7-814a-4215-a74c-299937a36b25-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:46 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-51df8741-ddd1-4bcf-8c24-dbb7d5c54116 tempest-VolumesActionsTest-1575556531 None] Detaching volume cf71b3e7-814a-4215-a74c-299937a36b25 from instance f0c26971-8ca3-4856-8405-5ddd62741390. Sep 28 17:23:46 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-51df8741-ddd1-4bcf-8c24-dbb7d5c54116 tempest-VolumesActionsTest-1575556531 None] Detach volume completed successfully. Sep 28 17:23:46 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-51df8741-ddd1-4bcf-8c24-dbb7d5c54116 tempest-VolumesActionsTest-1575556531 None] Lock "cinder-cf71b3e7-814a-4215-a74c-299937a36b25-detach_volume" released by "detach_volume" :: held 0.077s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a0b6f405-6709-4181-a45a-8af05c7e1ee2 tempest-ProjectReaderTests-1892409099 None] Acquiring lock "cinder-d860c520-44eb-4d3e-aebc-b91f689ab409-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a0b6f405-6709-4181-a45a-8af05c7e1ee2 tempest-ProjectReaderTests-1892409099 None] Lock "cinder-d860c520-44eb-4d3e-aebc-b91f689ab409-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a0b6f405-6709-4181-a45a-8af05c7e1ee2 tempest-ProjectReaderTests-1892409099 None] Acquiring lock "cinder-quobyte-d860c520-44eb-4d3e-aebc-b91f689ab409" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a0b6f405-6709-4181-a45a-8af05c7e1ee2 tempest-ProjectReaderTests-1892409099 None] Lock "cinder-quobyte-d860c520-44eb-4d3e-aebc-b91f689ab409" acquired by "delete_volume" :: waited 0.017s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:47 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba625df-ac40-4638-a1a4-3ec8884e1624]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0b6f405-6709-4181-a45a-8af05c7e1ee2 tempest-ProjectReaderTests-1892409099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d860c520-44eb-4d3e-aebc-b91f689ab409 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:47 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d860c520-44eb-4d3e-aebc-b91f689ab409 Sep 28 17:23:47 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:47 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0b6f405-6709-4181-a45a-8af05c7e1ee2 tempest-ProjectReaderTests-1892409099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d860c520-44eb-4d3e-aebc-b91f689ab409" returned: 0 in 0.487s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0b6f405-6709-4181-a45a-8af05c7e1ee2 tempest-ProjectReaderTests-1892409099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d860c520-44eb-4d3e-aebc-b91f689ab409 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:47 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d860c520-44eb-4d3e-aebc-b91f689ab409 Sep 28 17:23:47 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:48 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0b6f405-6709-4181-a45a-8af05c7e1ee2 tempest-ProjectReaderTests-1892409099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d860c520-44eb-4d3e-aebc-b91f689ab409" returned: 0 in 0.279s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:48 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a0b6f405-6709-4181-a45a-8af05c7e1ee2 tempest-ProjectReaderTests-1892409099 None] Lock "cinder-quobyte-d860c520-44eb-4d3e-aebc-b91f689ab409" released by "delete_volume" :: held 0.827s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:48 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-a0b6f405-6709-4181-a45a-8af05c7e1ee2 tempest-ProjectReaderTests-1892409099 None] Created reservations ['60603936-9861-4263-aca0-6fe1a6ae1921', 'ac5655af-1cc7-45c5-8960-538d6b6662af', 'dbe7e45d-94fe-4787-a68b-64ce52b7e34c', '691b2890-2b31-455c-a239-c5e191184a54'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a0b6f405-6709-4181-a45a-8af05c7e1ee2 tempest-ProjectReaderTests-1892409099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a0b6f405-6709-4181-a45a-8af05c7e1ee2 tempest-ProjectReaderTests-1892409099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:48 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a0b6f405-6709-4181-a45a-8af05c7e1ee2 tempest-ProjectReaderTests-1892409099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:48 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a0b6f405-6709-4181-a45a-8af05c7e1ee2 tempest-ProjectReaderTests-1892409099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a0b6f405-6709-4181-a45a-8af05c7e1ee2 tempest-ProjectReaderTests-1892409099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0b6f405-6709-4181-a45a-8af05c7e1ee2 tempest-ProjectReaderTests-1892409099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:48 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:23:48 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:48 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a0b6f405-6709-4181-a45a-8af05c7e1ee2 tempest-ProjectReaderTests-1892409099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.386s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:48 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-a0b6f405-6709-4181-a45a-8af05c7e1ee2 tempest-ProjectReaderTests-1892409099 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:48 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a0b6f405-6709-4181-a45a-8af05c7e1ee2 tempest-ProjectReaderTests-1892409099 None] Deleted volume successfully. Sep 28 17:23:48 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a0b6f405-6709-4181-a45a-8af05c7e1ee2 tempest-ProjectReaderTests-1892409099 None] Lock "cinder-d860c520-44eb-4d3e-aebc-b91f689ab409-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Flow 'volume_create_manager' (50da7cc2-010d-421e-a2b2-f6ab8678e243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1189527a-ff5c-4f74-b44c-cfbb9f1dd75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1189527a-ff5c-4f74-b44c-cfbb9f1dd75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-296060031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3cb8b9-467d-45b9-8496-98cf4ada3846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0993cd74d264abdbb25922bc7ddf4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:49Z,use_quota=True,user_id='34367c25bc8c4d51bc5e8089995061fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db04671-e9fd-44e7-a034-3ed8eab897de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db04671-e9fd-44e7-a034-3ed8eab897de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea01ea16-eced-496c-b79b-e995579a4400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea01ea16-eced-496c-b79b-e995579a4400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac3cb8b9-467d-45b9-8496-98cf4ada3846', 'volume_name': 'volume-ac3cb8b9-467d-45b9-8496-98cf4ada3846', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f0d81c-95fe-41d5-809b-afb17de1c38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f0d81c-95fe-41d5-809b-afb17de1c38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af71b625-afbb-49c7-b92b-53fda5b53010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:49 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Volume ac3cb8b9-467d-45b9-8496-98cf4ada3846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac3cb8b9-467d-45b9-8496-98cf4ada3846', 'volume_size': 1} Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-296060031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3cb8b9-467d-45b9-8496-98cf4ada3846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0993cd74d264abdbb25922bc7ddf4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:49Z,use_quota=True,user_id='34367c25bc8c4d51bc5e8089995061fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Creating volume ac3cb8b9-467d-45b9-8496-98cf4ada3846 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:49 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac3cb8b9-467d-45b9-8496-98cf4ada3846 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:49 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac3cb8b9-467d-45b9-8496-98cf4ada3846 1073741824 Sep 28 17:23:49 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:49 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac3cb8b9-467d-45b9-8496-98cf4ada3846 1073741824" returned: 0 in 0.515s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac3cb8b9-467d-45b9-8496-98cf4ada3846 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:49 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac3cb8b9-467d-45b9-8496-98cf4ada3846 Sep 28 17:23:49 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:50 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac3cb8b9-467d-45b9-8496-98cf4ada3846" returned: 0 in 0.338s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:50 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:50 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af71b625-afbb-49c7-b92b-53fda5b53010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac3cb8b9-467d-45b9-8496-98cf4ada3846', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:50 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a13cde-b820-46bb-85ac-a867154b9375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:50 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Volume volume-ac3cb8b9-467d-45b9-8496-98cf4ada3846 (ac3cb8b9-467d-45b9-8496-98cf4ada3846): created successfully Sep 28 17:23:50 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a13cde-b820-46bb-85ac-a867154b9375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:50 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Flow 'volume_create_manager' (50da7cc2-010d-421e-a2b2-f6ab8678e243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:50 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-90081171-f4dc-4602-8eb2-37015297a2ec tempest-ProjectReaderTests-1892409099 None] Created volume successfully. Sep 28 17:23:51 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-890cc964-80a5-43ab-9ec0-ddf160d1e19c tempest-ProjectReaderTests-1892409099 None] Acquiring lock "cinder-ac3cb8b9-467d-45b9-8496-98cf4ada3846-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:51 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-890cc964-80a5-43ab-9ec0-ddf160d1e19c tempest-ProjectReaderTests-1892409099 None] Lock "cinder-ac3cb8b9-467d-45b9-8496-98cf4ada3846-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:51 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-890cc964-80a5-43ab-9ec0-ddf160d1e19c tempest-ProjectReaderTests-1892409099 None] Acquiring lock "cinder-quobyte-ac3cb8b9-467d-45b9-8496-98cf4ada3846" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:51 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-890cc964-80a5-43ab-9ec0-ddf160d1e19c tempest-ProjectReaderTests-1892409099 None] Lock "cinder-quobyte-ac3cb8b9-467d-45b9-8496-98cf4ada3846" acquired by "delete_volume" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:51 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e80958-c9ad-4784-a076-4bbc998bdecb]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-890cc964-80a5-43ab-9ec0-ddf160d1e19c tempest-ProjectReaderTests-1892409099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac3cb8b9-467d-45b9-8496-98cf4ada3846 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:51 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac3cb8b9-467d-45b9-8496-98cf4ada3846 Sep 28 17:23:51 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:51 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-890cc964-80a5-43ab-9ec0-ddf160d1e19c tempest-ProjectReaderTests-1892409099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac3cb8b9-467d-45b9-8496-98cf4ada3846" returned: 0 in 0.511s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-890cc964-80a5-43ab-9ec0-ddf160d1e19c tempest-ProjectReaderTests-1892409099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac3cb8b9-467d-45b9-8496-98cf4ada3846 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:52 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac3cb8b9-467d-45b9-8496-98cf4ada3846 Sep 28 17:23:52 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:52 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-890cc964-80a5-43ab-9ec0-ddf160d1e19c tempest-ProjectReaderTests-1892409099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ac3cb8b9-467d-45b9-8496-98cf4ada3846" returned: 0 in 0.317s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:52 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-890cc964-80a5-43ab-9ec0-ddf160d1e19c tempest-ProjectReaderTests-1892409099 None] Lock "cinder-quobyte-ac3cb8b9-467d-45b9-8496-98cf4ada3846" released by "delete_volume" :: held 0.893s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:52 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-890cc964-80a5-43ab-9ec0-ddf160d1e19c tempest-ProjectReaderTests-1892409099 None] Created reservations ['0a9eed4a-8b04-4a6b-b423-62f16c50ce85', 'c54105d2-da01-41fe-bb36-56a47a8897f0', 'e6b67837-68c2-4ee9-852e-c496e9bded19', 'd8e09f7b-6697-4e1b-9991-0dd7ee0852e3'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-890cc964-80a5-43ab-9ec0-ddf160d1e19c tempest-ProjectReaderTests-1892409099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-890cc964-80a5-43ab-9ec0-ddf160d1e19c tempest-ProjectReaderTests-1892409099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:52 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-890cc964-80a5-43ab-9ec0-ddf160d1e19c tempest-ProjectReaderTests-1892409099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:52 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-890cc964-80a5-43ab-9ec0-ddf160d1e19c tempest-ProjectReaderTests-1892409099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-890cc964-80a5-43ab-9ec0-ddf160d1e19c tempest-ProjectReaderTests-1892409099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-890cc964-80a5-43ab-9ec0-ddf160d1e19c tempest-ProjectReaderTests-1892409099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:52 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:23:52 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:52 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-890cc964-80a5-43ab-9ec0-ddf160d1e19c tempest-ProjectReaderTests-1892409099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.341s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:52 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-890cc964-80a5-43ab-9ec0-ddf160d1e19c tempest-ProjectReaderTests-1892409099 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:52 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-890cc964-80a5-43ab-9ec0-ddf160d1e19c tempest-ProjectReaderTests-1892409099 None] Deleted volume successfully. Sep 28 17:23:52 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-890cc964-80a5-43ab-9ec0-ddf160d1e19c tempest-ProjectReaderTests-1892409099 None] Lock "cinder-ac3cb8b9-467d-45b9-8496-98cf4ada3846-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a19c50e1-4d9e-484c-8e3b-792c46e98543 tempest-VolumesActionsTest-1575556531 None] Acquiring lock "cinder-cf71b3e7-814a-4215-a74c-299937a36b25" by "attach_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a19c50e1-4d9e-484c-8e3b-792c46e98543 tempest-VolumesActionsTest-1575556531 None] Lock "cinder-cf71b3e7-814a-4215-a74c-299937a36b25" acquired by "attach_volume" :: waited 0.038s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:00 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a19c50e1-4d9e-484c-8e3b-792c46e98543 tempest-VolumesActionsTest-1575556531 None] Attaching volume cf71b3e7-814a-4215-a74c-299937a36b25 to instance 1363133b-52bb-4214-b4c4-135eca8368c3 at mountpoint /dev/vdb on host None. Sep 28 17:24:00 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a19c50e1-4d9e-484c-8e3b-792c46e98543 tempest-VolumesActionsTest-1575556531 None] Attach volume completed successfully. Sep 28 17:24:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a19c50e1-4d9e-484c-8e3b-792c46e98543 tempest-VolumesActionsTest-1575556531 None] Lock "cinder-cf71b3e7-814a-4215-a74c-299937a36b25" released by "attach_volume" :: held 0.133s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:01 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-117d991e-7525-4f87-bb17-7c59782e9f33 tempest-VolumesActionsTest-1575556531 None] Acquiring lock "cinder-cf71b3e7-814a-4215-a74c-299937a36b25-detach_volume" by "detach_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:01 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-117d991e-7525-4f87-bb17-7c59782e9f33 tempest-VolumesActionsTest-1575556531 None] Lock "cinder-cf71b3e7-814a-4215-a74c-299937a36b25-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:01 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-117d991e-7525-4f87-bb17-7c59782e9f33 tempest-VolumesActionsTest-1575556531 None] Detaching volume cf71b3e7-814a-4215-a74c-299937a36b25 from instance 1363133b-52bb-4214-b4c4-135eca8368c3. Sep 28 17:24:01 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-117d991e-7525-4f87-bb17-7c59782e9f33 tempest-VolumesActionsTest-1575556531 None] Detach volume completed successfully. Sep 28 17:24:01 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-117d991e-7525-4f87-bb17-7c59782e9f33 tempest-VolumesActionsTest-1575556531 None] Lock "cinder-cf71b3e7-814a-4215-a74c-299937a36b25-detach_volume" released by "detach_volume" :: held 0.077s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:24:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:06 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:24:06 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:07 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.297s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:24:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:24:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:24:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e3841549-8112-44fd-8388-d2aa9713fdb7 tempest-VolumesActionsTest-1575556531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e3841549-8112-44fd-8388-d2aa9713fdb7 tempest-VolumesActionsTest-1575556531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:07 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54873c4-0877-4344-97ef-c0f89be633d5]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e3841549-8112-44fd-8388-d2aa9713fdb7 tempest-VolumesActionsTest-1575556531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:07 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 Sep 28 17:24:07 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:07 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e3841549-8112-44fd-8388-d2aa9713fdb7 tempest-VolumesActionsTest-1575556531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25" returned: 0 in 0.448s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:07 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[373dcf63-1540-42a1-a1d0-e870670faa78]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e3841549-8112-44fd-8388-d2aa9713fdb7 tempest-VolumesActionsTest-1575556531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:07 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 Sep 28 17:24:07 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:08 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e3841549-8112-44fd-8388-d2aa9713fdb7 tempest-VolumesActionsTest-1575556531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25" returned: 0 in 0.442s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e3841549-8112-44fd-8388-d2aa9713fdb7 tempest-VolumesActionsTest-1575556531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 /opt/stack/data/cinder/conversion/cf71b3e7-814a-4215-a74c-299937a36b25.temp_image.3fea6139-d05f-4b61-9ca0-cfa0b3096fe0shy0a0yl.img {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:08 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 /opt/stack/data/cinder/conversion/cf71b3e7-814a-4215-a74c-299937a36b25.temp_image.3fea6139-d05f-4b61-9ca0-cfa0b3096fe0shy0a0yl.img Sep 28 17:24:08 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:11 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=45,cinder:INSERT=14,cinder:UPDATE=56,cinder:DELETE=7 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:24:15 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e3841549-8112-44fd-8388-d2aa9713fdb7 tempest-VolumesActionsTest-1575556531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 /opt/stack/data/cinder/conversion/cf71b3e7-814a-4215-a74c-299937a36b25.temp_image.3fea6139-d05f-4b61-9ca0-cfa0b3096fe0shy0a0yl.img" returned: 0 in 7.409s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:15 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[817dd79c-cfb8-4aee-9ab3-ba6a7ff97002]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e3841549-8112-44fd-8388-d2aa9713fdb7 tempest-VolumesActionsTest-1575556531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:15 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 Sep 28 17:24:15 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:16 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e3841549-8112-44fd-8388-d2aa9713fdb7 tempest-VolumesActionsTest-1575556531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25" returned: 0 in 0.539s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:16 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-e3841549-8112-44fd-8388-d2aa9713fdb7 tempest-VolumesActionsTest-1575556531 None] Image conversion details: src /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25, size 1024.00 MB, duration 7.41 sec, destination /opt/stack/data/cinder/conversion/cf71b3e7-814a-4215-a74c-299937a36b25.temp_image.3fea6139-d05f-4b61-9ca0-cfa0b3096fe0shy0a0yl.img {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:24:16 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-e3841549-8112-44fd-8388-d2aa9713fdb7 tempest-VolumesActionsTest-1575556531 None] Converted 1024.00 MB image at 138.19 MB/s Sep 28 17:24:16 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-e3841549-8112-44fd-8388-d2aa9713fdb7 tempest-VolumesActionsTest-1575556531 None] 3fea6139-d05f-4b61-9ca0-cfa0b3096fe0 was raw, no need to convert to raw {{(pid=87061) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 17:24:24 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Flow 'volume_create_manager' (f99a268a-877f-4897-af06-f7965834853b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e0c167-b356-48c9-8fd5-cca8976d1f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e0c167-b356-48c9-8fd5-cca8976d1f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1099894219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b1cb9c7-969e-46b4-9905-4538fa5d05d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bc79899a4747248595ac4839135552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:24Z,use_quota=True,user_id='22613a170bcf450eb6988c4d39d07385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4996a30-0663-4ab9-a919-e2afa0b82e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4996a30-0663-4ab9-a919-e2afa0b82e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59db3730-9e9a-4465-8335-5f2a2b945095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59db3730-9e9a-4465-8335-5f2a2b945095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b1cb9c7-969e-46b4-9905-4538fa5d05d1', 'volume_name': 'volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d574df3-dec6-4b68-8c90-f3714cfcf6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d574df3-dec6-4b68-8c90-f3714cfcf6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8731508d-62e3-4cc1-a162-f68810727cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:24 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Volume 1b1cb9c7-969e-46b4-9905-4538fa5d05d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1', 'volume_size': 1} Sep 28 17:24:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:26 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=57,cinder:UPDATE=57,cinder:DELETE=2,cinder:INSERT=15 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:24:34 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:24:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e3841549-8112-44fd-8388-d2aa9713fdb7 tempest-VolumesActionsTest-1575556531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.870s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e3841549-8112-44fd-8388-d2aa9713fdb7 tempest-VolumesActionsTest-1575556531 None] Uploaded volume to glance image-id: 3fea6139-d05f-4b61-9ca0-cfa0b3096fe0. {{(pid=87061) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 17:24:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.953s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1099894219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b1cb9c7-969e-46b4-9905-4538fa5d05d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bc79899a4747248595ac4839135552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:24Z,use_quota=True,user_id='22613a170bcf450eb6988c4d39d07385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Creating volume 1b1cb9c7-969e-46b4-9905-4538fa5d05d1 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:37 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:24:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:37 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 1073741824 Sep 28 17:24:37 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:37 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e3841549-8112-44fd-8388-d2aa9713fdb7 tempest-VolumesActionsTest-1575556531 None] Copy volume to image completed successfully. Sep 28 17:24:37 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 1073741824" returned: 0 in 0.507s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:37 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 Sep 28 17:24:37 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:38 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1" returned: 0 in 0.321s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8731508d-62e3-4cc1-a162-f68810727cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06ec41c-aefc-4ca8-ac3a-8e325d568bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:38 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Volume volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 (1b1cb9c7-969e-46b4-9905-4538fa5d05d1): created successfully Sep 28 17:24:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06ec41c-aefc-4ca8-ac3a-8e325d568bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Flow 'volume_create_manager' (f99a268a-877f-4897-af06-f7965834853b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:38 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-98300f19-43ab-4446-8559-03af90f98cf1 tempest-SnapshotDependencyTests-2088172038 None] Created volume successfully. Sep 28 17:24:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:39 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[917f6e31-be40-4341-8af0-c7e6bec4c732]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:39 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 Sep 28 17:24:39 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:39 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25" returned: 0 in 0.444s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:39 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[531cef7b-1bc6-4855-ae22-be100c3da4b5]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:39 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 Sep 28 17:24:39 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-bccfd93b-c867-42b0-80b0-107488b099e1 tempest-SnapshotDependencyTests-2088172038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:39 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25" returned: 0 in 0.410s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 /opt/stack/data/cinder/conversion/cf71b3e7-814a-4215-a74c-299937a36b25.temp_image.aa98326a-0a0a-4910-b23a-f8eb49b52cd3kziecnn8.img {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:39 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 /opt/stack/data/cinder/conversion/cf71b3e7-814a-4215-a74c-299937a36b25.temp_image.aa98326a-0a0a-4910-b23a-f8eb49b52cd3kziecnn8.img Sep 28 17:24:39 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:46 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 /opt/stack/data/cinder/conversion/cf71b3e7-814a-4215-a74c-299937a36b25.temp_image.aa98326a-0a0a-4910-b23a-f8eb49b52cd3kziecnn8.img" returned: 0 in 6.313s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:46 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d4b788-f363-4ab2-8e1b-ae68b60ba856]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:46 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 Sep 28 17:24:46 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:46 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25" returned: 0 in 0.550s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:46 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] Image conversion details: src /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25, size 1024.00 MB, duration 6.31 sec, destination /opt/stack/data/cinder/conversion/cf71b3e7-814a-4215-a74c-299937a36b25.temp_image.aa98326a-0a0a-4910-b23a-f8eb49b52cd3kziecnn8.img {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:24:46 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] Converted 1024.00 MB image at 162.16 MB/s Sep 28 17:24:46 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] aa98326a-0a0a-4910-b23a-f8eb49b52cd3 was raw, converting to qcow2 {{(pid=87061) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 17:24:46 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[53715f07-9bdb-48cf-b3ba-e072e0065736]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cf71b3e7-814a-4215-a74c-299937a36b25.temp_image.aa98326a-0a0a-4910-b23a-f8eb49b52cd3kziecnn8.img {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:46 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cf71b3e7-814a-4215-a74c-299937a36b25.temp_image.aa98326a-0a0a-4910-b23a-f8eb49b52cd3kziecnn8.img Sep 28 17:24:46 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:47 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cf71b3e7-814a-4215-a74c-299937a36b25.temp_image.aa98326a-0a0a-4910-b23a-f8eb49b52cd3kziecnn8.img" returned: 0 in 0.343s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cf71b3e7-814a-4215-a74c-299937a36b25.temp_image.aa98326a-0a0a-4910-b23a-f8eb49b52cd3kziecnn8.img {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:47 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cf71b3e7-814a-4215-a74c-299937a36b25.temp_image.aa98326a-0a0a-4910-b23a-f8eb49b52cd3kziecnn8.img Sep 28 17:24:47 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:47 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cf71b3e7-814a-4215-a74c-299937a36b25.temp_image.aa98326a-0a0a-4910-b23a-f8eb49b52cd3kziecnn8.img" returned: 1 in 0.312s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cf71b3e7-814a-4215-a74c-299937a36b25.temp_image.aa98326a-0a0a-4910-b23a-f8eb49b52cd3kziecnn8.img' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:24:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cf71b3e7-814a-4215-a74c-299937a36b25.temp_image.aa98326a-0a0a-4910-b23a-f8eb49b52cd3kziecnn8.img /opt/stack/data/cinder/conversion/vol_upload_44z55y17 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:47 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cf71b3e7-814a-4215-a74c-299937a36b25.temp_image.aa98326a-0a0a-4910-b23a-f8eb49b52cd3kziecnn8.img /opt/stack/data/cinder/conversion/vol_upload_44z55y17 Sep 28 17:24:47 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:47 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cf71b3e7-814a-4215-a74c-299937a36b25.temp_image.aa98326a-0a0a-4910-b23a-f8eb49b52cd3kziecnn8.img /opt/stack/data/cinder/conversion/vol_upload_44z55y17" returned: 0 in 0.277s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:47 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] Image conversion details: src /opt/stack/data/cinder/conversion/cf71b3e7-814a-4215-a74c-299937a36b25.temp_image.aa98326a-0a0a-4910-b23a-f8eb49b52cd3kziecnn8.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_44z55y17 {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:24:47 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 17:24:47 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dd42f1-b485-48b2-9b8a-873319034200]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_44z55y17 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:47 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_44z55y17 Sep 28 17:24:47 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:48 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_44z55y17" returned: 0 in 0.329s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.419s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] Uploaded volume to glance image-id: aa98326a-0a0a-4910-b23a-f8eb49b52cd3. {{(pid=87061) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 17:24:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-bccfd93b-c867-42b0-80b0-107488b099e1 tempest-SnapshotDependencyTests-2088172038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.708s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:49 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-bccfd93b-c867-42b0-80b0-107488b099e1 tempest-SnapshotDependencyTests-2088172038 None] Creating offline snapshot 9e6ce603-7ee9-4345-ac7f-64a268acd190 of volume 1b1cb9c7-969e-46b4-9905-4538fa5d05d1 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:24:49 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[167555f0-103b-4744-9bc4-e4bdb0271b90]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bccfd93b-c867-42b0-80b0-107488b099e1 tempest-SnapshotDependencyTests-2088172038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:49 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-b721b97a-2732-448f-8737-43cff0004969 tempest-VolumesActionsTest-1575556531 None] Copy volume to image completed successfully. Sep 28 17:24:49 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 Sep 28 17:24:49 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:49 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bccfd93b-c867-42b0-80b0-107488b099e1 tempest-SnapshotDependencyTests-2088172038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1" returned: 0 in 0.392s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bccfd93b-c867-42b0-80b0-107488b099e1 tempest-SnapshotDependencyTests-2088172038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:49 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190 1G Sep 28 17:24:49 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:50 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-61c81687-4d5f-45e3-b566-7c850c5aa2af tempest-VolumesActionsTest-1575556531 None] Acquiring lock "cinder-cf71b3e7-814a-4215-a74c-299937a36b25-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:50 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-61c81687-4d5f-45e3-b566-7c850c5aa2af tempest-VolumesActionsTest-1575556531 None] Lock "cinder-cf71b3e7-814a-4215-a74c-299937a36b25-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:50 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-61c81687-4d5f-45e3-b566-7c850c5aa2af tempest-VolumesActionsTest-1575556531 None] Acquiring lock "cinder-quobyte-cf71b3e7-814a-4215-a74c-299937a36b25" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:50 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-61c81687-4d5f-45e3-b566-7c850c5aa2af tempest-VolumesActionsTest-1575556531 None] Lock "cinder-quobyte-cf71b3e7-814a-4215-a74c-299937a36b25" acquired by "delete_volume" :: waited 0.019s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:50 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde06957-e5ee-4c19-bb81-a9a8eb1a62f0]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-61c81687-4d5f-45e3-b566-7c850c5aa2af tempest-VolumesActionsTest-1575556531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:50 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bccfd93b-c867-42b0-80b0-107488b099e1 tempest-SnapshotDependencyTests-2088172038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190 1G" returned: 0 in 0.512s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bccfd93b-c867-42b0-80b0-107488b099e1 tempest-SnapshotDependencyTests-2088172038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:50 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190 Sep 28 17:24:50 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:50 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 Sep 28 17:24:50 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:50 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bccfd93b-c867-42b0-80b0-107488b099e1 tempest-SnapshotDependencyTests-2088172038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190" returned: 0 in 0.339s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:50 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-bccfd93b-c867-42b0-80b0-107488b099e1 tempest-SnapshotDependencyTests-2088172038 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190 is being set with open permissions: ugo+rw Sep 28 17:24:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bccfd93b-c867-42b0-80b0-107488b099e1 tempest-SnapshotDependencyTests-2088172038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:50 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190 Sep 28 17:24:50 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:50 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-61c81687-4d5f-45e3-b566-7c850c5aa2af tempest-VolumesActionsTest-1575556531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25" returned: 0 in 0.418s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-61c81687-4d5f-45e3-b566-7c850c5aa2af tempest-VolumesActionsTest-1575556531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:50 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25 Sep 28 17:24:50 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:51 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bccfd93b-c867-42b0-80b0-107488b099e1 tempest-SnapshotDependencyTests-2088172038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190" returned: 0 in 0.261s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bccfd93b-c867-42b0-80b0-107488b099e1 tempest-SnapshotDependencyTests-2088172038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:51 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-61c81687-4d5f-45e3-b566-7c850c5aa2af tempest-VolumesActionsTest-1575556531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cf71b3e7-814a-4215-a74c-299937a36b25" returned: 0 in 0.286s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:51 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.info Sep 28 17:24:51 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:51 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-61c81687-4d5f-45e3-b566-7c850c5aa2af tempest-VolumesActionsTest-1575556531 None] Lock "cinder-quobyte-cf71b3e7-814a-4215-a74c-299937a36b25" released by "delete_volume" :: held 0.750s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:51 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-61c81687-4d5f-45e3-b566-7c850c5aa2af tempest-VolumesActionsTest-1575556531 None] Created reservations ['ded5baee-52c6-41cb-8772-58c4fee49b15', 'c0102121-bd77-47d5-a079-e287214cc734', '27678571-0627-4123-9bde-2423d3a1a373', '3f9c10f4-a032-4299-be5b-f254af222f38'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-61c81687-4d5f-45e3-b566-7c850c5aa2af tempest-VolumesActionsTest-1575556531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-61c81687-4d5f-45e3-b566-7c850c5aa2af tempest-VolumesActionsTest-1575556531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-61c81687-4d5f-45e3-b566-7c850c5aa2af tempest-VolumesActionsTest-1575556531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-61c81687-4d5f-45e3-b566-7c850c5aa2af tempest-VolumesActionsTest-1575556531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-61c81687-4d5f-45e3-b566-7c850c5aa2af tempest-VolumesActionsTest-1575556531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-61c81687-4d5f-45e3-b566-7c850c5aa2af tempest-VolumesActionsTest-1575556531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:51 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:24:51 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:51 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bccfd93b-c867-42b0-80b0-107488b099e1 tempest-SnapshotDependencyTests-2088172038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.info" returned: 0 in 0.311s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:51 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-bccfd93b-c867-42b0-80b0-107488b099e1 tempest-SnapshotDependencyTests-2088172038 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.info is being set with open permissions: ugo+rw Sep 28 17:24:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bccfd93b-c867-42b0-80b0-107488b099e1 tempest-SnapshotDependencyTests-2088172038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:51 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.info Sep 28 17:24:51 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:51 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-61c81687-4d5f-45e3-b566-7c850c5aa2af tempest-VolumesActionsTest-1575556531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.298s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:51 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-61c81687-4d5f-45e3-b566-7c850c5aa2af tempest-VolumesActionsTest-1575556531 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:51 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-61c81687-4d5f-45e3-b566-7c850c5aa2af tempest-VolumesActionsTest-1575556531 None] Deleted volume successfully. Sep 28 17:24:51 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-61c81687-4d5f-45e3-b566-7c850c5aa2af tempest-VolumesActionsTest-1575556531 None] Lock "cinder-cf71b3e7-814a-4215-a74c-299937a36b25-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:51 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bccfd93b-c867-42b0-80b0-107488b099e1 tempest-SnapshotDependencyTests-2088172038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.info" returned: 0 in 0.287s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-bccfd93b-c867-42b0-80b0-107488b099e1 tempest-SnapshotDependencyTests-2088172038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.220s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:51 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-bccfd93b-c867-42b0-80b0-107488b099e1 tempest-SnapshotDependencyTests-2088172038 None] Create snapshot completed successfully Sep 28 17:24:52 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Flow 'volume_create_manager' (48f2347f-c7d7-4f2a-bbb6-43efbda0f91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f14923-e430-4935-863a-88fd0ffda2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f14923-e430-4935-863a-88fd0ffda2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd47d81-41ba-402f-a430-f79c3e3e69e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bc79899a4747248595ac4839135552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9e6ce603-7ee9-4345-ac7f-64a268acd190,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:53Z,use_quota=True,user_id='22613a170bcf450eb6988c4d39d07385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (086ba627-ab2e-4306-b479-bd45c2db3586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (086ba627-ab2e-4306-b479-bd45c2db3586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5bd06aa-a548-4309-8b96-3509a5a6fdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5bd06aa-a548-4309-8b96-3509a5a6fdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0cd47d81-41ba-402f-a430-f79c3e3e69e4', 'volume_name': 'volume-0cd47d81-41ba-402f-a430-f79c3e3e69e4', 'volume_size': 1, 'snapshot_id': '9e6ce603-7ee9-4345-ac7f-64a268acd190'}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda8ee30-8766-4b22-8430-28f11942df63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda8ee30-8766-4b22-8430-28f11942df63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965963ff-9473-4930-84ef-b47048193361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:53 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Volume 0cd47d81-41ba-402f-a430-f79c3e3e69e4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0cd47d81-41ba-402f-a430-f79c3e3e69e4', 'volume_size': 1, 'snapshot_id': '9e6ce603-7ee9-4345-ac7f-64a268acd190'} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Acquiring lock "cinder-quobyte-9e6ce603-7ee9-4345-ac7f-64a268acd190-0cd47d81-41ba-402f-a430-f79c3e3e69e4" by "_create_volume_from_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Lock "cinder-quobyte-9e6ce603-7ee9-4345-ac7f-64a268acd190-0cd47d81-41ba-402f-a430-f79c3e3e69e4" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Creating volume 0cd47d81-41ba-402f-a430-f79c3e3e69e4 from snapshot 9e6ce603-7ee9-4345-ac7f-64a268acd190 {{(pid=87061) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Acquiring lock "cinder-quobyte-0cd47d81-41ba-402f-a430-f79c3e3e69e4" by "_copy_volume_from_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Lock "cinder-quobyte-0cd47d81-41ba-402f-a430-f79c3e3e69e4" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] snapshot: 9e6ce603-7ee9-4345-ac7f-64a268acd190, volume: 0cd47d81-41ba-402f-a430-f79c3e3e69e4, {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f09dfc3-a871-4387-847a-fda661ed9c24]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:53 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190 Sep 28 17:24:53 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:53 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190" returned: 0 in 0.460s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[128efcc6-c548-46ed-8fda-ed49715657bc]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:53 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 Sep 28 17:24:53 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:54 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1" returned: 0 in 0.437s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:54 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:24:54 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Creating direct copy from snapshot {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:24:54 devstack cinder-volume[87061]: DEBUG cinder.utils [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Path /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0cd47d81-41ba-402f-a430-f79c3e3e69e4 not found in is_blk_device check {{(pid=87061) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:24:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0cd47d81-41ba-402f-a430-f79c3e3e69e4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:54 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0cd47d81-41ba-402f-a430-f79c3e3e69e4 Sep 28 17:24:54 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:01 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0cd47d81-41ba-402f-a430-f79c3e3e69e4" returned: 0 in 7.727s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:01 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Image conversion details: src /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1, size 1024.00 MB, duration 7.73 sec, destination /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0cd47d81-41ba-402f-a430-f79c3e3e69e4 {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:25:01 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Converted 1024.00 MB image at 132.50 MB/s Sep 28 17:25:01 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0cd47d81-41ba-402f-a430-f79c3e3e69e4 is being set with open permissions: ugo+rw Sep 28 17:25:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0cd47d81-41ba-402f-a430-f79c3e3e69e4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:01 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0cd47d81-41ba-402f-a430-f79c3e3e69e4 Sep 28 17:25:01 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:02 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0cd47d81-41ba-402f-a430-f79c3e3e69e4" returned: 0 in 0.310s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:02 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Lock "cinder-quobyte-0cd47d81-41ba-402f-a430-f79c3e3e69e4" released by "_copy_volume_from_snapshot" :: held 9.039s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:02 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Lock "cinder-quobyte-9e6ce603-7ee9-4345-ac7f-64a268acd190-0cd47d81-41ba-402f-a430-f79c3e3e69e4" released by "_create_volume_from_snapshot" :: held 9.136s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.158s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965963ff-9473-4930-84ef-b47048193361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cd47d81-41ba-402f-a430-f79c3e3e69e4', 'volume_size': 1, 'snapshot_id': '9e6ce603-7ee9-4345-ac7f-64a268acd190'}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10c2819-816c-499b-a8eb-010414e39b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:02 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Volume volume-0cd47d81-41ba-402f-a430-f79c3e3e69e4 (0cd47d81-41ba-402f-a430-f79c3e3e69e4): created successfully Sep 28 17:25:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10c2819-816c-499b-a8eb-010414e39b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Flow 'volume_create_manager' (48f2347f-c7d7-4f2a-bbb6-43efbda0f91d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:02 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-1fb1111d-5318-408b-a109-741f5b9c5d9a tempest-SnapshotDependencyTests-2088172038 None] Created volume successfully. Sep 28 17:25:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f5c4b012-22ce-41be-a101-b745cf3668c3 tempest-SnapshotDependencyTests-2088172038 None] Acquiring lock "cinder-9e6ce603-7ee9-4345-ac7f-64a268acd190-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f5c4b012-22ce-41be-a101-b745cf3668c3 tempest-SnapshotDependencyTests-2088172038 None] Lock "cinder-9e6ce603-7ee9-4345-ac7f-64a268acd190-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f5c4b012-22ce-41be-a101-b745cf3668c3 tempest-SnapshotDependencyTests-2088172038 None] Acquiring lock "cinder-quobyte-1b1cb9c7-969e-46b4-9905-4538fa5d05d1" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f5c4b012-22ce-41be-a101-b745cf3668c3 tempest-SnapshotDependencyTests-2088172038 None] Lock "cinder-quobyte-1b1cb9c7-969e-46b4-9905-4538fa5d05d1" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f5c4b012-22ce-41be-a101-b745cf3668c3 tempest-SnapshotDependencyTests-2088172038 None] Acquiring lock "cinder-quobyte-9e6ce603-7ee9-4345-ac7f-64a268acd190" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f5c4b012-22ce-41be-a101-b745cf3668c3 tempest-SnapshotDependencyTests-2088172038 None] Lock "cinder-quobyte-9e6ce603-7ee9-4345-ac7f-64a268acd190" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-f5c4b012-22ce-41be-a101-b745cf3668c3 tempest-SnapshotDependencyTests-2088172038 None] Deleting offline snapshot 9e6ce603-7ee9-4345-ac7f-64a268acd190 of volume 1b1cb9c7-969e-46b4-9905-4538fa5d05d1 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:25:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-f5c4b012-22ce-41be-a101-b745cf3668c3 tempest-SnapshotDependencyTests-2088172038 None] snapshot_file for this snap is: volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:25:03 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c04b4ba-0b03-40b7-9c14-ab9a1e2bfb92]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f5c4b012-22ce-41be-a101-b745cf3668c3 tempest-SnapshotDependencyTests-2088172038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:03 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190 Sep 28 17:25:03 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:03 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f5c4b012-22ce-41be-a101-b745cf3668c3 tempest-SnapshotDependencyTests-2088172038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190" returned: 0 in 0.446s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-f5c4b012-22ce-41be-a101-b745cf3668c3 tempest-SnapshotDependencyTests-2088172038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:25:03 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff38c20-b1c3-43b5-8392-f671cc6291eb]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f5c4b012-22ce-41be-a101-b745cf3668c3 tempest-SnapshotDependencyTests-2088172038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:03 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 Sep 28 17:25:03 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:04 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f5c4b012-22ce-41be-a101-b745cf3668c3 tempest-SnapshotDependencyTests-2088172038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1" returned: 0 in 0.609s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f5c4b012-22ce-41be-a101-b745cf3668c3 tempest-SnapshotDependencyTests-2088172038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:04 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190 Sep 28 17:25:04 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:04 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f5c4b012-22ce-41be-a101-b745cf3668c3 tempest-SnapshotDependencyTests-2088172038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190" returned: 0 in 0.457s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f5c4b012-22ce-41be-a101-b745cf3668c3 tempest-SnapshotDependencyTests-2088172038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:04 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190 Sep 28 17:25:04 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:05 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f5c4b012-22ce-41be-a101-b745cf3668c3 tempest-SnapshotDependencyTests-2088172038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1.9e6ce603-7ee9-4345-ac7f-64a268acd190" returned: 0 in 0.293s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f5c4b012-22ce-41be-a101-b745cf3668c3 tempest-SnapshotDependencyTests-2088172038 None] Lock "cinder-quobyte-9e6ce603-7ee9-4345-ac7f-64a268acd190" released by "_delete_snapshot" :: held 1.955s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f5c4b012-22ce-41be-a101-b745cf3668c3 tempest-SnapshotDependencyTests-2088172038 None] Lock "cinder-quobyte-1b1cb9c7-969e-46b4-9905-4538fa5d05d1" released by "delete_snapshot" :: held 1.989s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:05 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-f5c4b012-22ce-41be-a101-b745cf3668c3 tempest-SnapshotDependencyTests-2088172038 None] Created reservations ['1d408370-9cd5-4b04-a555-02677ab51252', 'eb73c721-3fd3-4395-bbe6-ac65d8065638', '6abaf4e7-9055-4eae-af0b-a7128e95f070', '13b819e4-17e5-4101-a705-e490825a998f'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:05 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-f5c4b012-22ce-41be-a101-b745cf3668c3 tempest-SnapshotDependencyTests-2088172038 None] Delete snapshot completed successfully. Sep 28 17:25:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f5c4b012-22ce-41be-a101-b745cf3668c3 tempest-SnapshotDependencyTests-2088172038 None] Lock "cinder-9e6ce603-7ee9-4345-ac7f-64a268acd190-delete_snapshot" released by "delete_snapshot" :: held 2.172s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e7b24cc5-a2b6-417d-8e08-320184dfa016 tempest-SnapshotDependencyTests-2088172038 None] Acquiring lock "cinder-1b1cb9c7-969e-46b4-9905-4538fa5d05d1-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e7b24cc5-a2b6-417d-8e08-320184dfa016 tempest-SnapshotDependencyTests-2088172038 None] Lock "cinder-1b1cb9c7-969e-46b4-9905-4538fa5d05d1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e7b24cc5-a2b6-417d-8e08-320184dfa016 tempest-SnapshotDependencyTests-2088172038 None] Acquiring lock "cinder-quobyte-1b1cb9c7-969e-46b4-9905-4538fa5d05d1" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e7b24cc5-a2b6-417d-8e08-320184dfa016 tempest-SnapshotDependencyTests-2088172038 None] Lock "cinder-quobyte-1b1cb9c7-969e-46b4-9905-4538fa5d05d1" acquired by "delete_volume" :: waited 0.029s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:06 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[c086a422-fa55-4292-a443-983fc327f7e0]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e7b24cc5-a2b6-417d-8e08-320184dfa016 tempest-SnapshotDependencyTests-2088172038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:06 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 Sep 28 17:25:06 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:25:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:06 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:25:06 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:06 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e7b24cc5-a2b6-417d-8e08-320184dfa016 tempest-SnapshotDependencyTests-2088172038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1" returned: 0 in 0.492s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e7b24cc5-a2b6-417d-8e08-320184dfa016 tempest-SnapshotDependencyTests-2088172038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:06 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1 Sep 28 17:25:06 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:07 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.304s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:25:07 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e7b24cc5-a2b6-417d-8e08-320184dfa016 tempest-SnapshotDependencyTests-2088172038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1b1cb9c7-969e-46b4-9905-4538fa5d05d1" returned: 0 in 0.279s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e7b24cc5-a2b6-417d-8e08-320184dfa016 tempest-SnapshotDependencyTests-2088172038 None] Lock "cinder-quobyte-1b1cb9c7-969e-46b4-9905-4538fa5d05d1" released by "delete_volume" :: held 0.852s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-e7b24cc5-a2b6-417d-8e08-320184dfa016 tempest-SnapshotDependencyTests-2088172038 None] Created reservations ['e870af42-7182-4029-ace8-256b1a84bf51', '24db6b10-6196-4cd2-93d0-a796148ca849', '1284069f-b886-4a5d-81bf-7a99ab70e1cb', 'a9cff0a6-ae2a-45e7-a753-e851920b2e8a'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e7b24cc5-a2b6-417d-8e08-320184dfa016 tempest-SnapshotDependencyTests-2088172038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e7b24cc5-a2b6-417d-8e08-320184dfa016 tempest-SnapshotDependencyTests-2088172038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e7b24cc5-a2b6-417d-8e08-320184dfa016 tempest-SnapshotDependencyTests-2088172038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e7b24cc5-a2b6-417d-8e08-320184dfa016 tempest-SnapshotDependencyTests-2088172038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e7b24cc5-a2b6-417d-8e08-320184dfa016 tempest-SnapshotDependencyTests-2088172038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e7b24cc5-a2b6-417d-8e08-320184dfa016 tempest-SnapshotDependencyTests-2088172038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:07 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:25:07 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c14b6646-3eba-4ad5-9b1f-4f93b431676a tempest-SnapshotDependencyTests-2088172038 None] Acquiring lock "cinder-0cd47d81-41ba-402f-a430-f79c3e3e69e4-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c14b6646-3eba-4ad5-9b1f-4f93b431676a tempest-SnapshotDependencyTests-2088172038 None] Lock "cinder-0cd47d81-41ba-402f-a430-f79c3e3e69e4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c14b6646-3eba-4ad5-9b1f-4f93b431676a tempest-SnapshotDependencyTests-2088172038 None] Acquiring lock "cinder-quobyte-0cd47d81-41ba-402f-a430-f79c3e3e69e4" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c14b6646-3eba-4ad5-9b1f-4f93b431676a tempest-SnapshotDependencyTests-2088172038 None] Lock "cinder-quobyte-0cd47d81-41ba-402f-a430-f79c3e3e69e4" acquired by "delete_volume" :: waited 0.019s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bda5be-6490-4526-9b4e-ce6d404e8a3b]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c14b6646-3eba-4ad5-9b1f-4f93b431676a tempest-SnapshotDependencyTests-2088172038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0cd47d81-41ba-402f-a430-f79c3e3e69e4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:07 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e7b24cc5-a2b6-417d-8e08-320184dfa016 tempest-SnapshotDependencyTests-2088172038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.324s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-e7b24cc5-a2b6-417d-8e08-320184dfa016 tempest-SnapshotDependencyTests-2088172038 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:07 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e7b24cc5-a2b6-417d-8e08-320184dfa016 tempest-SnapshotDependencyTests-2088172038 None] Deleted volume successfully. Sep 28 17:25:07 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0cd47d81-41ba-402f-a430-f79c3e3e69e4 Sep 28 17:25:07 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e7b24cc5-a2b6-417d-8e08-320184dfa016 tempest-SnapshotDependencyTests-2088172038 None] Lock "cinder-1b1cb9c7-969e-46b4-9905-4538fa5d05d1-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:08 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c14b6646-3eba-4ad5-9b1f-4f93b431676a tempest-SnapshotDependencyTests-2088172038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0cd47d81-41ba-402f-a430-f79c3e3e69e4" returned: 0 in 0.494s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c14b6646-3eba-4ad5-9b1f-4f93b431676a tempest-SnapshotDependencyTests-2088172038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0cd47d81-41ba-402f-a430-f79c3e3e69e4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:08 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0cd47d81-41ba-402f-a430-f79c3e3e69e4 Sep 28 17:25:08 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:08 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c14b6646-3eba-4ad5-9b1f-4f93b431676a tempest-SnapshotDependencyTests-2088172038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0cd47d81-41ba-402f-a430-f79c3e3e69e4" returned: 0 in 0.299s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:08 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c14b6646-3eba-4ad5-9b1f-4f93b431676a tempest-SnapshotDependencyTests-2088172038 None] Lock "cinder-quobyte-0cd47d81-41ba-402f-a430-f79c3e3e69e4" released by "delete_volume" :: held 0.858s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:08 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-c14b6646-3eba-4ad5-9b1f-4f93b431676a tempest-SnapshotDependencyTests-2088172038 None] Created reservations ['49280e1c-0a82-4d10-a816-1fcc9bcda0d3', 'f1d07b1f-edab-417e-820a-c68c4d7f033a', '06b45313-2a6f-4494-933d-63719fbee80e', '542eba4e-0171-43c5-a6c2-2efb94fc438f'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c14b6646-3eba-4ad5-9b1f-4f93b431676a tempest-SnapshotDependencyTests-2088172038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c14b6646-3eba-4ad5-9b1f-4f93b431676a tempest-SnapshotDependencyTests-2088172038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c14b6646-3eba-4ad5-9b1f-4f93b431676a tempest-SnapshotDependencyTests-2088172038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c14b6646-3eba-4ad5-9b1f-4f93b431676a tempest-SnapshotDependencyTests-2088172038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c14b6646-3eba-4ad5-9b1f-4f93b431676a tempest-SnapshotDependencyTests-2088172038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c14b6646-3eba-4ad5-9b1f-4f93b431676a tempest-SnapshotDependencyTests-2088172038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:08 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:25:08 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:09 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c14b6646-3eba-4ad5-9b1f-4f93b431676a tempest-SnapshotDependencyTests-2088172038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.343s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:09 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-c14b6646-3eba-4ad5-9b1f-4f93b431676a tempest-SnapshotDependencyTests-2088172038 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:09 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-c14b6646-3eba-4ad5-9b1f-4f93b431676a tempest-SnapshotDependencyTests-2088172038 None] Deleted volume successfully. Sep 28 17:25:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c14b6646-3eba-4ad5-9b1f-4f93b431676a tempest-SnapshotDependencyTests-2088172038 None] Lock "cinder-0cd47d81-41ba-402f-a430-f79c3e3e69e4-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:18 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=31,cinder:INSERT=12,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:25:19 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:UPDATE=46,cinder:SELECT=32,cinder:INSERT=7,cinder:DELETE=4 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:25:29 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Flow 'volume_create_manager' (180d96b5-c1bd-40f3-9415-747fb97119a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f1151a-0665-4444-816d-2a29b3138cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f1151a-0665-4444-816d-2a29b3138cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1156423257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb93766a-553d-4ced-a376-db47ff70d581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f9765f0dbf427b9832585277a54836',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:29Z,use_quota=True,user_id='42fcd5fe9aa14dcabe9376783a3527f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc964de-73fc-48ec-b257-3fe3035d2ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc964de-73fc-48ec-b257-3fe3035d2ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97941a9d-7287-4c45-aec9-8401787f0dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97941a9d-7287-4c45-aec9-8401787f0dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb93766a-553d-4ced-a376-db47ff70d581', 'volume_name': 'volume-bb93766a-553d-4ced-a376-db47ff70d581', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca181732-5e38-42ee-8706-5d179c07c0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca181732-5e38-42ee-8706-5d179c07c0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d415e6-bcd9-429f-9c38-e9f2d2eec382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:29 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Volume bb93766a-553d-4ced-a376-db47ff70d581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb93766a-553d-4ced-a376-db47ff70d581', 'volume_size': 1} Sep 28 17:25:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1156423257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb93766a-553d-4ced-a376-db47ff70d581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f9765f0dbf427b9832585277a54836',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:29Z,use_quota=True,user_id='42fcd5fe9aa14dcabe9376783a3527f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Creating volume bb93766a-553d-4ced-a376-db47ff70d581 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:29 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:25:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:29 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581 1073741824 Sep 28 17:25:29 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:30 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581 1073741824" returned: 0 in 0.529s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:30 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581 Sep 28 17:25:30 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:30 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581" returned: 0 in 0.282s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:30 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:25:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:30 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d415e6-bcd9-429f-9c38-e9f2d2eec382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb93766a-553d-4ced-a376-db47ff70d581', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:30 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0caa32-f8dc-458e-a812-738d983ab22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:30 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Volume volume-bb93766a-553d-4ced-a376-db47ff70d581 (bb93766a-553d-4ced-a376-db47ff70d581): created successfully Sep 28 17:25:30 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0caa32-f8dc-458e-a812-738d983ab22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:30 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Flow 'volume_create_manager' (180d96b5-c1bd-40f3-9415-747fb97119a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:30 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-2a973b27-c86e-4ff5-b6c1-a949dc56fd0c tempest-TestStampPattern-742113714 None] Created volume successfully. Sep 28 17:25:40 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:UPDATE=5 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:25:40 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:26:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-48037969-8402-47d5-90db-72605255ad30 req-79a4a41a-ea5f-4b22-83ff-33d7d02bdf3e tempest-TestStampPattern-742113714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-48037969-8402-47d5-90db-72605255ad30 req-79a4a41a-ea5f-4b22-83ff-33d7d02bdf3e tempest-TestStampPattern-742113714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-48037969-8402-47d5-90db-72605255ad30 req-79a4a41a-ea5f-4b22-83ff-33d7d02bdf3e tempest-TestStampPattern-742113714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-48037969-8402-47d5-90db-72605255ad30 req-79a4a41a-ea5f-4b22-83ff-33d7d02bdf3e tempest-TestStampPattern-742113714 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-bb93766a-553d-4ced-a376-db47ff70d581', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8661964d-6670-40c8-8e07-4ce00ed379ea', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:26:02 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-48037969-8402-47d5-90db-72605255ad30 req-79a4a41a-ea5f-4b22-83ff-33d7d02bdf3e tempest-TestStampPattern-742113714 None] attachment_update completed successfully. Sep 28 17:26:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:26:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:06 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:26:06 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:07 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.302s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:26:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:26:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:26:07 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-bf4ac708-4c76-42bf-bd0e-36a07a047f30 req-1a67259f-b07e-4932-9d6f-3fdb2dd73908 tempest-TestStampPattern-742113714 None] Terminate volume connection completed successfully. Sep 28 17:26:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-bf4ac708-4c76-42bf-bd0e-36a07a047f30 req-1a67259f-b07e-4932-9d6f-3fdb2dd73908 tempest-TestStampPattern-742113714 None] Deleting attachment 8661964d-6670-40c8-8e07-4ce00ed379ea. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:26:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1fc19040-e9e8-4241-b619-d4f5f9951ed0 tempest-TestStampPattern-742113714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1fc19040-e9e8-4241-b619-d4f5f9951ed0 tempest-TestStampPattern-742113714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-1fc19040-e9e8-4241-b619-d4f5f9951ed0 tempest-TestStampPattern-742113714 None] Creating offline snapshot 9a4a1a66-b557-41a2-b617-839887854eab of volume bb93766a-553d-4ced-a376-db47ff70d581 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:26:08 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a647dd8b-7144-45d9-a8de-0a4d03fd9646]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1fc19040-e9e8-4241-b619-d4f5f9951ed0 tempest-TestStampPattern-742113714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:08 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581 Sep 28 17:26:08 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:08 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1fc19040-e9e8-4241-b619-d4f5f9951ed0 tempest-TestStampPattern-742113714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581" returned: 0 in 0.390s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1fc19040-e9e8-4241-b619-d4f5f9951ed0 tempest-TestStampPattern-742113714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:08 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab 1G Sep 28 17:26:08 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:09 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1fc19040-e9e8-4241-b619-d4f5f9951ed0 tempest-TestStampPattern-742113714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab 1G" returned: 0 in 0.435s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1fc19040-e9e8-4241-b619-d4f5f9951ed0 tempest-TestStampPattern-742113714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb93766a-553d-4ced-a376-db47ff70d581 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:09 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb93766a-553d-4ced-a376-db47ff70d581 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab Sep 28 17:26:09 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:09 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1fc19040-e9e8-4241-b619-d4f5f9951ed0 tempest-TestStampPattern-742113714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb93766a-553d-4ced-a376-db47ff70d581 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab" returned: 0 in 0.331s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:09 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-1fc19040-e9e8-4241-b619-d4f5f9951ed0 tempest-TestStampPattern-742113714 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab is being set with open permissions: ugo+rw Sep 28 17:26:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1fc19040-e9e8-4241-b619-d4f5f9951ed0 tempest-TestStampPattern-742113714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:09 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab Sep 28 17:26:09 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:09 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1fc19040-e9e8-4241-b619-d4f5f9951ed0 tempest-TestStampPattern-742113714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab" returned: 0 in 0.281s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1fc19040-e9e8-4241-b619-d4f5f9951ed0 tempest-TestStampPattern-742113714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:09 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.info Sep 28 17:26:09 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:10 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1fc19040-e9e8-4241-b619-d4f5f9951ed0 tempest-TestStampPattern-742113714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.info" returned: 0 in 0.310s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:10 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-1fc19040-e9e8-4241-b619-d4f5f9951ed0 tempest-TestStampPattern-742113714 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.info is being set with open permissions: ugo+rw Sep 28 17:26:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1fc19040-e9e8-4241-b619-d4f5f9951ed0 tempest-TestStampPattern-742113714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:10 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.info Sep 28 17:26:10 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:10 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1fc19040-e9e8-4241-b619-d4f5f9951ed0 tempest-TestStampPattern-742113714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.info" returned: 0 in 0.273s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1fc19040-e9e8-4241-b619-d4f5f9951ed0 tempest-TestStampPattern-742113714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.121s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:10 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-1fc19040-e9e8-4241-b619-d4f5f9951ed0 tempest-TestStampPattern-742113714 None] Create snapshot completed successfully Sep 28 17:26:20 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:26:20 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=11,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Flow 'volume_create_manager' (0fc35510-225b-43e1-90d3-e3b4f2033a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a5c156d-2700-4205-8446-5efecbe5483e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a5c156d-2700-4205-8446-5efecbe5483e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1424190861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f9765f0dbf427b9832585277a54836',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9a4a1a66-b557-41a2-b617-839887854eab,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:20Z,use_quota=True,user_id='42fcd5fe9aa14dcabe9376783a3527f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a14e65-9937-4724-a83a-147ecf2f2a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a14e65-9937-4724-a83a-147ecf2f2a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4afdfb-dc4a-468e-a676-5704e24bbc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4afdfb-dc4a-468e-a676-5704e24bbc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8', 'volume_name': 'volume-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8', 'volume_size': 1, 'snapshot_id': '9a4a1a66-b557-41a2-b617-839887854eab'}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33dead4d-707a-41e2-a8fb-3a06a09e7dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33dead4d-707a-41e2-a8fb-3a06a09e7dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (285efc4a-fd97-458b-ae12-01cf3819d65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:24 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Volume 4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8', 'volume_size': 1, 'snapshot_id': '9a4a1a66-b557-41a2-b617-839887854eab'} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Acquiring lock "cinder-quobyte-9a4a1a66-b557-41a2-b617-839887854eab-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8" by "_create_volume_from_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Lock "cinder-quobyte-9a4a1a66-b557-41a2-b617-839887854eab-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Creating volume 4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8 from snapshot 9a4a1a66-b557-41a2-b617-839887854eab {{(pid=87061) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Acquiring lock "cinder-quobyte-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8" by "_copy_volume_from_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Lock "cinder-quobyte-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] snapshot: 9a4a1a66-b557-41a2-b617-839887854eab, volume: 4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8, {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:26:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:25 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:25 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:25 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1946e56-abae-45ae-9f96-e7abcc267f64]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:25 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab Sep 28 17:26:25 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:26 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab" returned: 0 in 0.468s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb93766a-553d-4ced-a376-db47ff70d581(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:26:26 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[530984eb-b1ac-4a3c-8ff3-6d4fe5ebbd0a]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:26 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581 Sep 28 17:26:26 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:26 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581" returned: 0 in 0.465s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581 {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:26:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Creating direct copy from snapshot {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:26:26 devstack cinder-volume[87061]: DEBUG cinder.utils [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Path /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8 not found in is_blk_device check {{(pid=87061) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:26:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:26 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8 Sep 28 17:26:26 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:35 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:26:35 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8" returned: 0 in 8.998s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:35 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Image conversion details: src /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581, size 1024.00 MB, duration 9.00 sec, destination /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8 {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:26:35 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Converted 1024.00 MB image at 113.79 MB/s Sep 28 17:26:35 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8 is being set with open permissions: ugo+rw Sep 28 17:26:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:35 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8 Sep 28 17:26:35 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:36 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8" returned: 0 in 0.272s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Lock "cinder-quobyte-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8" released by "_copy_volume_from_snapshot" :: held 11.285s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Lock "cinder-quobyte-9a4a1a66-b557-41a2-b617-839887854eab-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8" released by "_create_volume_from_snapshot" :: held 11.357s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.375s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (285efc4a-fd97-458b-ae12-01cf3819d65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8', 'volume_size': 1, 'snapshot_id': '9a4a1a66-b557-41a2-b617-839887854eab'}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65d1a9ea-2cf8-4eed-ba7f-211feba2ce90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:36 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Volume volume-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8 (4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8): created successfully Sep 28 17:26:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65d1a9ea-2cf8-4eed-ba7f-211feba2ce90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Flow 'volume_create_manager' (0fc35510-225b-43e1-90d3-e3b4f2033a21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:36 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-1d99c547-4399-4590-96c4-f092b5cbed91 tempest-TestStampPattern-742113714 None] Created volume successfully. Sep 28 17:26:52 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:26:52 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:27:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:27:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:27:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:27:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-3bd94605-8028-4517-86a6-b6e592dade36 req-1f8c660b-5eee-4b52-9896-238e94794667 tempest-TestStampPattern-742113714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-3bd94605-8028-4517-86a6-b6e592dade36 req-1f8c660b-5eee-4b52-9896-238e94794667 tempest-TestStampPattern-742113714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [req-3bd94605-8028-4517-86a6-b6e592dade36 req-1f8c660b-5eee-4b52-9896-238e94794667 tempest-TestStampPattern-742113714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-3bd94605-8028-4517-86a6-b6e592dade36 req-1f8c660b-5eee-4b52-9896-238e94794667 tempest-TestStampPattern-742113714 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d', 'name': 'volume-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08d8e29c-f3f0-4b5f-8fd1-b4c3ac06c364', 'enforce_multipath': True} {{(pid=87061) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:27:18 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-3bd94605-8028-4517-86a6-b6e592dade36 req-1f8c660b-5eee-4b52-9896-238e94794667 tempest-TestStampPattern-742113714 None] attachment_update completed successfully. Sep 28 17:27:22 devstack cinder-volume[87061]: INFO cinder.volume.manager [req-3b2fa23d-bf97-4e5c-bbd5-738e556ff002 req-8d9e1874-a229-4004-82b6-a96251c6756d tempest-TestStampPattern-742113714 None] Terminate volume connection completed successfully. Sep 28 17:27:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [req-3b2fa23d-bf97-4e5c-bbd5-738e556ff002 req-8d9e1874-a229-4004-82b6-a96251c6756d tempest-TestStampPattern-742113714 None] Deleting attachment 08d8e29c-f3f0-4b5f-8fd1-b4c3ac06c364. {{(pid=87061) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:27:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a565ad5c-0815-4f49-9d29-c3fc353dfc61 tempest-TestStampPattern-742113714 None] Acquiring lock "cinder-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a565ad5c-0815-4f49-9d29-c3fc353dfc61 tempest-TestStampPattern-742113714 None] Lock "cinder-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a565ad5c-0815-4f49-9d29-c3fc353dfc61 tempest-TestStampPattern-742113714 None] Acquiring lock "cinder-quobyte-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a565ad5c-0815-4f49-9d29-c3fc353dfc61 tempest-TestStampPattern-742113714 None] Lock "cinder-quobyte-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8" acquired by "delete_volume" :: waited 0.025s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:26 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[14af2532-5b49-4d5f-8b88-46466614d000]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a565ad5c-0815-4f49-9d29-c3fc353dfc61 tempest-TestStampPattern-742113714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:26 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8 Sep 28 17:27:26 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:27 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a565ad5c-0815-4f49-9d29-c3fc353dfc61 tempest-TestStampPattern-742113714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8" returned: 0 in 0.419s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a565ad5c-0815-4f49-9d29-c3fc353dfc61 tempest-TestStampPattern-742113714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:27 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8 Sep 28 17:27:27 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:27 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a565ad5c-0815-4f49-9d29-c3fc353dfc61 tempest-TestStampPattern-742113714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8" returned: 0 in 0.275s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:27 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a565ad5c-0815-4f49-9d29-c3fc353dfc61 tempest-TestStampPattern-742113714 None] Lock "cinder-quobyte-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8" released by "delete_volume" :: held 0.747s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:27 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-a565ad5c-0815-4f49-9d29-c3fc353dfc61 tempest-TestStampPattern-742113714 None] Created reservations ['64a95bec-1c1b-4f0c-b2b2-b7e62a042622', 'fb95f427-7a05-4ded-a68d-3450c654a590', '9d0a5b90-408c-44e4-a433-2b47d6806a2d', 'd6b7376e-beb1-4373-a037-f99c04189aa2'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a565ad5c-0815-4f49-9d29-c3fc353dfc61 tempest-TestStampPattern-742113714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a565ad5c-0815-4f49-9d29-c3fc353dfc61 tempest-TestStampPattern-742113714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:27 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a565ad5c-0815-4f49-9d29-c3fc353dfc61 tempest-TestStampPattern-742113714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:27 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-a565ad5c-0815-4f49-9d29-c3fc353dfc61 tempest-TestStampPattern-742113714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a565ad5c-0815-4f49-9d29-c3fc353dfc61 tempest-TestStampPattern-742113714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a565ad5c-0815-4f49-9d29-c3fc353dfc61 tempest-TestStampPattern-742113714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:27 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:27:27 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:27 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a565ad5c-0815-4f49-9d29-c3fc353dfc61 tempest-TestStampPattern-742113714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.294s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:27 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-a565ad5c-0815-4f49-9d29-c3fc353dfc61 tempest-TestStampPattern-742113714 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:27 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a565ad5c-0815-4f49-9d29-c3fc353dfc61 tempest-TestStampPattern-742113714 None] Deleted volume successfully. Sep 28 17:27:27 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a565ad5c-0815-4f49-9d29-c3fc353dfc61 tempest-TestStampPattern-742113714 None] Lock "cinder-4ebc19a1-3a8d-475e-b0f5-c4f779e2d1a8-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:28 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2ffe8efc-86ef-4d63-a98b-4c6308f3e780 tempest-TestStampPattern-742113714 None] Acquiring lock "cinder-9a4a1a66-b557-41a2-b617-839887854eab-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:28 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2ffe8efc-86ef-4d63-a98b-4c6308f3e780 tempest-TestStampPattern-742113714 None] Lock "cinder-9a4a1a66-b557-41a2-b617-839887854eab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:28 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2ffe8efc-86ef-4d63-a98b-4c6308f3e780 tempest-TestStampPattern-742113714 None] Acquiring lock "cinder-quobyte-bb93766a-553d-4ced-a376-db47ff70d581" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:28 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2ffe8efc-86ef-4d63-a98b-4c6308f3e780 tempest-TestStampPattern-742113714 None] Lock "cinder-quobyte-bb93766a-553d-4ced-a376-db47ff70d581" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:28 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2ffe8efc-86ef-4d63-a98b-4c6308f3e780 tempest-TestStampPattern-742113714 None] Acquiring lock "cinder-quobyte-9a4a1a66-b557-41a2-b617-839887854eab" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:28 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2ffe8efc-86ef-4d63-a98b-4c6308f3e780 tempest-TestStampPattern-742113714 None] Lock "cinder-quobyte-9a4a1a66-b557-41a2-b617-839887854eab" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-2ffe8efc-86ef-4d63-a98b-4c6308f3e780 tempest-TestStampPattern-742113714 None] Deleting offline snapshot 9a4a1a66-b557-41a2-b617-839887854eab of volume bb93766a-553d-4ced-a376-db47ff70d581 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:27:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-2ffe8efc-86ef-4d63-a98b-4c6308f3e780 tempest-TestStampPattern-742113714 None] snapshot_file for this snap is: volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:27:28 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a5ab76-5846-406a-8aa7-e7e863e06d56]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2ffe8efc-86ef-4d63-a98b-4c6308f3e780 tempest-TestStampPattern-742113714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:28 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab Sep 28 17:27:28 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:28 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2ffe8efc-86ef-4d63-a98b-4c6308f3e780 tempest-TestStampPattern-742113714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab" returned: 0 in 0.415s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-2ffe8efc-86ef-4d63-a98b-4c6308f3e780 tempest-TestStampPattern-742113714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb93766a-553d-4ced-a376-db47ff70d581(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:27:28 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fdc05a-9c0a-4224-b0ea-082006609bb2]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2ffe8efc-86ef-4d63-a98b-4c6308f3e780 tempest-TestStampPattern-742113714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:28 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581 Sep 28 17:27:28 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:29 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2ffe8efc-86ef-4d63-a98b-4c6308f3e780 tempest-TestStampPattern-742113714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581" returned: 0 in 0.607s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2ffe8efc-86ef-4d63-a98b-4c6308f3e780 tempest-TestStampPattern-742113714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:29 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab Sep 28 17:27:29 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:29 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2ffe8efc-86ef-4d63-a98b-4c6308f3e780 tempest-TestStampPattern-742113714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab" returned: 0 in 0.381s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2ffe8efc-86ef-4d63-a98b-4c6308f3e780 tempest-TestStampPattern-742113714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:29 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab Sep 28 17:27:29 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:30 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2ffe8efc-86ef-4d63-a98b-4c6308f3e780 tempest-TestStampPattern-742113714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581.9a4a1a66-b557-41a2-b617-839887854eab" returned: 0 in 0.269s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2ffe8efc-86ef-4d63-a98b-4c6308f3e780 tempest-TestStampPattern-742113714 None] Lock "cinder-quobyte-9a4a1a66-b557-41a2-b617-839887854eab" released by "_delete_snapshot" :: held 1.830s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2ffe8efc-86ef-4d63-a98b-4c6308f3e780 tempest-TestStampPattern-742113714 None] Lock "cinder-quobyte-bb93766a-553d-4ced-a376-db47ff70d581" released by "delete_snapshot" :: held 1.870s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:30 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-2ffe8efc-86ef-4d63-a98b-4c6308f3e780 tempest-TestStampPattern-742113714 None] Created reservations ['d6a65cbd-a84d-49e0-a593-42f505dccc6c', '880ce84f-c8d2-463f-9581-8ff9c3fae6e4', '5a2b1a3d-f092-4234-ac91-0d33fe235577', 'fe995176-114b-4e6c-9600-ad118029853a'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:30 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-2ffe8efc-86ef-4d63-a98b-4c6308f3e780 tempest-TestStampPattern-742113714 None] Delete snapshot completed successfully. Sep 28 17:27:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2ffe8efc-86ef-4d63-a98b-4c6308f3e780 tempest-TestStampPattern-742113714 None] Lock "cinder-9a4a1a66-b557-41a2-b617-839887854eab-delete_snapshot" released by "delete_snapshot" :: held 2.020s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:34 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-209090f7-a7a2-433c-8907-1d488a20c75f tempest-TestStampPattern-742113714 None] Acquiring lock "cinder-bb93766a-553d-4ced-a376-db47ff70d581-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:34 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-209090f7-a7a2-433c-8907-1d488a20c75f tempest-TestStampPattern-742113714 None] Lock "cinder-bb93766a-553d-4ced-a376-db47ff70d581-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:34 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-209090f7-a7a2-433c-8907-1d488a20c75f tempest-TestStampPattern-742113714 None] Acquiring lock "cinder-quobyte-bb93766a-553d-4ced-a376-db47ff70d581" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:34 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-209090f7-a7a2-433c-8907-1d488a20c75f tempest-TestStampPattern-742113714 None] Lock "cinder-quobyte-bb93766a-553d-4ced-a376-db47ff70d581" acquired by "delete_volume" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:34 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a505c6f-e1ab-485f-a8af-601e38d8b070]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-209090f7-a7a2-433c-8907-1d488a20c75f tempest-TestStampPattern-742113714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:34 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581 Sep 28 17:27:34 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:34 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-209090f7-a7a2-433c-8907-1d488a20c75f tempest-TestStampPattern-742113714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581" returned: 0 in 0.392s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-209090f7-a7a2-433c-8907-1d488a20c75f tempest-TestStampPattern-742113714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:34 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581 Sep 28 17:27:34 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:35 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-209090f7-a7a2-433c-8907-1d488a20c75f tempest-TestStampPattern-742113714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-bb93766a-553d-4ced-a376-db47ff70d581" returned: 0 in 0.277s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:35 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-209090f7-a7a2-433c-8907-1d488a20c75f tempest-TestStampPattern-742113714 None] Lock "cinder-quobyte-bb93766a-553d-4ced-a376-db47ff70d581" released by "delete_volume" :: held 0.734s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:35 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-209090f7-a7a2-433c-8907-1d488a20c75f tempest-TestStampPattern-742113714 None] Created reservations ['37b9b13f-0463-448f-9be3-b6e9dc170856', '3905b28b-b3c8-4e26-96e5-bf408e8a3af5', 'e4f7f473-ac97-4ade-b3c2-6df11a83e461', 'e866967c-ab75-4bcd-a189-1d8cfb2b9c95'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-209090f7-a7a2-433c-8907-1d488a20c75f tempest-TestStampPattern-742113714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-209090f7-a7a2-433c-8907-1d488a20c75f tempest-TestStampPattern-742113714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-209090f7-a7a2-433c-8907-1d488a20c75f tempest-TestStampPattern-742113714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-209090f7-a7a2-433c-8907-1d488a20c75f tempest-TestStampPattern-742113714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-209090f7-a7a2-433c-8907-1d488a20c75f tempest-TestStampPattern-742113714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-209090f7-a7a2-433c-8907-1d488a20c75f tempest-TestStampPattern-742113714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:35 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:27:35 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:35 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-209090f7-a7a2-433c-8907-1d488a20c75f tempest-TestStampPattern-742113714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.277s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:35 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-209090f7-a7a2-433c-8907-1d488a20c75f tempest-TestStampPattern-742113714 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:35 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-209090f7-a7a2-433c-8907-1d488a20c75f tempest-TestStampPattern-742113714 None] Deleted volume successfully. Sep 28 17:27:35 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-209090f7-a7a2-433c-8907-1d488a20c75f tempest-TestStampPattern-742113714 None] Lock "cinder-bb93766a-553d-4ced-a376-db47ff70d581-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:45 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=18,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:27:45 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=28,cinder:INSERT=6,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:27:51 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Flow 'volume_create_manager' (c840266d-5781-4394-98e1-5cce63cf3e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae12099d-e59c-4ae4-80bf-acc4467455cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae12099d-e59c-4ae4-80bf-acc4467455cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff96ab5-699e-4d51-80f2-805d1165ee0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db31583c94545c79b49dbe27cab3811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:51Z,use_quota=True,user_id='5ecb6b88462149be9d0ce0bae03edcb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96991e6c-34ed-4854-866f-37ee53d6f419),volume_type_id=96991e6c-34ed-4854-866f-37ee53d6f419)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa5d1606-690d-4123-968a-5579e486006a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa5d1606-690d-4123-968a-5579e486006a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce4a578-8f25-4580-aeec-7d823490d7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:51 devstack cinder-volume[87061]: DEBUG cinder.image.glance [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Creating Keystone auth plugin from conf {{(pid=87061) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:27:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce4a578-8f25-4580-aeec-7d823490d7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dff96ab5-699e-4d51-80f2-805d1165ee0a', 'volume_name': 'volume-dff96ab5-699e-4d51-80f2-805d1165ee0a', 'volume_size': 1, 'image_id': '6dc526b0-4453-4706-9fb9-2d07fb4cbb66', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dc526b0-4453-4706-9fb9-2d07fb4cbb66', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '62df953ce740bce60e18de8a2893eb07', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8db31583c94545c79b49dbe27cab3811', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '904b947814e1e4e73441f6ab74cd10c6c43661e2df289059fbf3eb8576ced100b649a1d09097fb799a5b24aad7bdb63a66330d82b9f6bda6b8b1ab9d988f6ffb', 'id': '6dc526b0-4453-4706-9fb9-2d07fb4cbb66', 'created_at': datetime.datetime(2026, 9, 28, 15, 27, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 27, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dc526b0-4453-4706-9fb9-2d07fb4cbb66/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e041b75d-74e6-48ce-b1dd-552e2a3ecc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e041b75d-74e6-48ce-b1dd-552e2a3ecc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:51 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9be892-ac09-4599-b1ea-dd072a0456f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:51 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Volume dff96ab5-699e-4d51-80f2-805d1165ee0a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dff96ab5-699e-4d51-80f2-805d1165ee0a', 'volume_size': 1, 'image_id': '6dc526b0-4453-4706-9fb9-2d07fb4cbb66', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dc526b0-4453-4706-9fb9-2d07fb4cbb66', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '62df953ce740bce60e18de8a2893eb07', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8db31583c94545c79b49dbe27cab3811', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '904b947814e1e4e73441f6ab74cd10c6c43661e2df289059fbf3eb8576ced100b649a1d09097fb799a5b24aad7bdb63a66330d82b9f6bda6b8b1ab9d988f6ffb', 'id': '6dc526b0-4453-4706-9fb9-2d07fb4cbb66', 'created_at': datetime.datetime(2026, 9, 28, 15, 27, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 27, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dc526b0-4453-4706-9fb9-2d07fb4cbb66/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 17:27:51 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Trying to clone dff96ab5-699e-4d51-80f2-805d1165ee0a from image 6dc526b0-4453-4706-9fb9-2d07fb4cbb66 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6dc526b0-4453-4706-9fb9-2d07fb4cbb66', 'metadata': {}}]). {{(pid=87061) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:27:51 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:27:51 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:27:52 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a29c88-cae9-4e9b-9578-023e520667b1]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:52 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD Sep 28 17:27:52 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:52 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:52 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD Sep 28 17:27:52 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:52 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD" returned: 1 in 0.349s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:27:52 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Temporary image 6dc526b0-4453-4706-9fb9-2d07fb4cbb66 is fetched for user 5ecb6b88462149be9d0ce0bae03edcb3. {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:27:52 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5698a48-ea6f-498c-8f50-582ca3a8712f]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:52 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD Sep 28 17:27:52 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:53 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:53 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD Sep 28 17:27:53 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:53 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD" returned: 1 in 0.389s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:27:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff96ab5-699e-4d51-80f2-805d1165ee0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db31583c94545c79b49dbe27cab3811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:51Z,use_quota=True,user_id='5ecb6b88462149be9d0ce0bae03edcb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96991e6c-34ed-4854-866f-37ee53d6f419),volume_type_id=96991e6c-34ed-4854-866f-37ee53d6f419)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Creating volume dff96ab5-699e-4d51-80f2-805d1165ee0a {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:53 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:27:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-dff96ab5-699e-4d51-80f2-805d1165ee0a 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:53 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-dff96ab5-699e-4d51-80f2-805d1165ee0a 1073741824 Sep 28 17:27:53 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:54 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-dff96ab5-699e-4d51-80f2-805d1165ee0a 1073741824" returned: 0 in 0.524s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-dff96ab5-699e-4d51-80f2-805d1165ee0a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:54 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-dff96ab5-699e-4d51-80f2-805d1165ee0a Sep 28 17:27:54 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:54 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-dff96ab5-699e-4d51-80f2-805d1165ee0a" returned: 0 in 0.270s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:54 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:54 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Attempting download of 6dc526b0-4453-4706-9fb9-2d07fb4cbb66 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dc526b0-4453-4706-9fb9-2d07fb4cbb66', 'metadata': {}}])) to volume dff96ab5-699e-4d51-80f2-805d1165ee0a. {{(pid=87061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:27:54 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7cd837-7304-4c81-bced-a96012727e20]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_y2jxwz9c {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:54 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_y2jxwz9c Sep 28 17:27:54 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:54 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_y2jxwz9c" returned: 0 in 0.350s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_y2jxwz9c {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:54 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_y2jxwz9c Sep 28 17:27:54 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:55 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_y2jxwz9c" returned: 1 in 0.324s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_y2jxwz9c' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:27:55 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8e25bd-bfb7-4818-b72c-3e77435b1339]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:55 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD Sep 28 17:27:55 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:55 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD" returned: 0 in 0.364s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:55 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD Sep 28 17:27:55 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:55 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD" returned: 1 in 0.369s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:27:55 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] 6dc526b0-4453-4706-9fb9-2d07fb4cbb66 was raw, converting to qcow2 {{(pid=87061) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:27:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-dff96ab5-699e-4d51-80f2-805d1165ee0a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:55 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-dff96ab5-699e-4d51-80f2-805d1165ee0a Sep 28 17:27:55 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:56 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-dff96ab5-699e-4d51-80f2-805d1165ee0a" returned: 0 in 0.534s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:56 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6dc526b0-4453-4706-9fb9-2d07fb4cbb66_uu4p38n1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-dff96ab5-699e-4d51-80f2-805d1165ee0a {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:27:56 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:27:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-dff96ab5-699e-4d51-80f2-805d1165ee0a 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:56 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-dff96ab5-699e-4d51-80f2-805d1165ee0a 1G Sep 28 17:27:56 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:56 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-dff96ab5-699e-4d51-80f2-805d1165ee0a 1G" returned: 0 in 0.341s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:56 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Downloaded image 6dc526b0-4453-4706-9fb9-2d07fb4cbb66 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dc526b0-4453-4706-9fb9-2d07fb4cbb66', 'metadata': {}}])) to volume dff96ab5-699e-4d51-80f2-805d1165ee0a successfully. {{(pid=87061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:27:56 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Temporary image 6dc526b0-4453-4706-9fb9-2d07fb4cbb66 for user 5ecb6b88462149be9d0ce0bae03edcb3 is deleted. {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:27:56 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Marking volume dff96ab5-699e-4d51-80f2-805d1165ee0a as bootable. {{(pid=87061) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:27:56 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Copying metadata from image 6dc526b0-4453-4706-9fb9-2d07fb4cbb66 to dff96ab5-699e-4d51-80f2-805d1165ee0a. {{(pid=87061) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:27:56 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Creating volume glance metadata for volume dff96ab5-699e-4d51-80f2-805d1165ee0a backed by image 6dc526b0-4453-4706-9fb9-2d07fb4cbb66 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6dc526b0-4453-4706-9fb9-2d07fb4cbb66', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '62df953ce740bce60e18de8a2893eb07', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87061) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:27:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9be892-ac09-4599-b1ea-dd072a0456f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dff96ab5-699e-4d51-80f2-805d1165ee0a', 'volume_size': 1, 'image_id': '6dc526b0-4453-4706-9fb9-2d07fb4cbb66', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dc526b0-4453-4706-9fb9-2d07fb4cbb66', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '62df953ce740bce60e18de8a2893eb07', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8db31583c94545c79b49dbe27cab3811', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '904b947814e1e4e73441f6ab74cd10c6c43661e2df289059fbf3eb8576ced100b649a1d09097fb799a5b24aad7bdb63a66330d82b9f6bda6b8b1ab9d988f6ffb', 'id': '6dc526b0-4453-4706-9fb9-2d07fb4cbb66', 'created_at': datetime.datetime(2026, 9, 28, 15, 27, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 27, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dc526b0-4453-4706-9fb9-2d07fb4cbb66/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e0f934-b21a-4cd1-9846-f38a63fc70b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:56 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Volume volume-dff96ab5-699e-4d51-80f2-805d1165ee0a (dff96ab5-699e-4d51-80f2-805d1165ee0a): created successfully Sep 28 17:27:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e0f934-b21a-4cd1-9846-f38a63fc70b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:56 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Flow 'volume_create_manager' (c840266d-5781-4394-98e1-5cce63cf3e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:56 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-be36639a-f317-4382-9ee3-4d0c6871acf7 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Created volume successfully. Sep 28 17:27:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5ab24ae3-0398-4380-8775-368e2069fc07 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Acquiring lock "cinder-dff96ab5-699e-4d51-80f2-805d1165ee0a-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5ab24ae3-0398-4380-8775-368e2069fc07 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Lock "cinder-dff96ab5-699e-4d51-80f2-805d1165ee0a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5ab24ae3-0398-4380-8775-368e2069fc07 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Acquiring lock "cinder-quobyte-dff96ab5-699e-4d51-80f2-805d1165ee0a" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5ab24ae3-0398-4380-8775-368e2069fc07 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Lock "cinder-quobyte-dff96ab5-699e-4d51-80f2-805d1165ee0a" acquired by "delete_volume" :: waited 0.015s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:57 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[d582e652-758c-44f4-9fdc-0111e82bcfe4]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ab24ae3-0398-4380-8775-368e2069fc07 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-dff96ab5-699e-4d51-80f2-805d1165ee0a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:58 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-dff96ab5-699e-4d51-80f2-805d1165ee0a Sep 28 17:27:58 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:58 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ab24ae3-0398-4380-8775-368e2069fc07 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-dff96ab5-699e-4d51-80f2-805d1165ee0a" returned: 0 in 0.431s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ab24ae3-0398-4380-8775-368e2069fc07 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-dff96ab5-699e-4d51-80f2-805d1165ee0a {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:58 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-dff96ab5-699e-4d51-80f2-805d1165ee0a Sep 28 17:27:58 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:58 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ab24ae3-0398-4380-8775-368e2069fc07 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-dff96ab5-699e-4d51-80f2-805d1165ee0a" returned: 0 in 0.267s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:58 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5ab24ae3-0398-4380-8775-368e2069fc07 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Lock "cinder-quobyte-dff96ab5-699e-4d51-80f2-805d1165ee0a" released by "delete_volume" :: held 0.761s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:58 devstack cinder-volume[87061]: WARNING cinder.quota [None req-5ab24ae3-0398-4380-8775-368e2069fc07 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:27:58 devstack cinder-volume[87061]: WARNING cinder.quota [None req-5ab24ae3-0398-4380-8775-368e2069fc07 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:27:58 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-5ab24ae3-0398-4380-8775-368e2069fc07 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Created reservations ['f9e48633-ff75-4aa5-82c5-297a8a00b986', 'd61a3d8f-3a16-4334-81e6-517b6deb2a60', 'd21fa9af-479f-41ab-99dd-36f0df63be26', 'a0d7f9d3-8382-415f-9c9d-c931ab871541'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5ab24ae3-0398-4380-8775-368e2069fc07 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5ab24ae3-0398-4380-8775-368e2069fc07 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-5ab24ae3-0398-4380-8775-368e2069fc07 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-5ab24ae3-0398-4380-8775-368e2069fc07 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5ab24ae3-0398-4380-8775-368e2069fc07 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ab24ae3-0398-4380-8775-368e2069fc07 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:58 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:27:58 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:59 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ab24ae3-0398-4380-8775-368e2069fc07 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.285s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:59 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-5ab24ae3-0398-4380-8775-368e2069fc07 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:59 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-5ab24ae3-0398-4380-8775-368e2069fc07 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Deleted volume successfully. Sep 28 17:27:59 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5ab24ae3-0398-4380-8775-368e2069fc07 tempest-VolumeAndVolumeTypeFromImageTest-520194405 None] Lock "cinder-dff96ab5-699e-4d51-80f2-805d1165ee0a-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:03 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Flow 'volume_create_manager' (4cb282c4-e78c-440d-848c-449d90883a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26468fd2-1d5a-40bc-bf58-a03280c57a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26468fd2-1d5a-40bc-bf58-a03280c57a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2038998933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df9dd72-0ce6-4307-9451-f198dfa5eb1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b9e87f17fe49d8a6a8a5055b8f4e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:04Z,use_quota=True,user_id='220a7813b69b41ae8b4a5c04dc314848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1e541b-f097-4851-a159-e67285c5dbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1e541b-f097-4851-a159-e67285c5dbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e39ab2-56d2-41a5-a64a-c4d557b84650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e39ab2-56d2-41a5-a64a-c4d557b84650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1df9dd72-0ce6-4307-9451-f198dfa5eb1d', 'volume_name': 'volume-1df9dd72-0ce6-4307-9451-f198dfa5eb1d', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200097ff-7153-4c1d-9a29-3f7a58aec660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200097ff-7153-4c1d-9a29-3f7a58aec660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d7ebcb-6283-4b00-aa60-4a961a5a47e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:03 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Volume 1df9dd72-0ce6-4307-9451-f198dfa5eb1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1df9dd72-0ce6-4307-9451-f198dfa5eb1d', 'volume_size': 1} Sep 28 17:28:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2038998933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df9dd72-0ce6-4307-9451-f198dfa5eb1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b9e87f17fe49d8a6a8a5055b8f4e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:04Z,use_quota=True,user_id='220a7813b69b41ae8b4a5c04dc314848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Creating volume 1df9dd72-0ce6-4307-9451-f198dfa5eb1d {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:03 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:28:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1df9dd72-0ce6-4307-9451-f198dfa5eb1d 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:03 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1df9dd72-0ce6-4307-9451-f198dfa5eb1d 1073741824 Sep 28 17:28:03 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:04 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1df9dd72-0ce6-4307-9451-f198dfa5eb1d 1073741824" returned: 0 in 0.475s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1df9dd72-0ce6-4307-9451-f198dfa5eb1d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:04 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1df9dd72-0ce6-4307-9451-f198dfa5eb1d Sep 28 17:28:04 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:04 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1df9dd72-0ce6-4307-9451-f198dfa5eb1d" returned: 0 in 0.241s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d7ebcb-6283-4b00-aa60-4a961a5a47e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1df9dd72-0ce6-4307-9451-f198dfa5eb1d', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (981f0700-e257-4971-ae50-16119760cf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:04 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Volume volume-1df9dd72-0ce6-4307-9451-f198dfa5eb1d (1df9dd72-0ce6-4307-9451-f198dfa5eb1d): created successfully Sep 28 17:28:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (981f0700-e257-4971-ae50-16119760cf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Flow 'volume_create_manager' (4cb282c4-e78c-440d-848c-449d90883a34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:04 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-0346e3ed-50e1-4c69-ab3c-ee6f8b5882db tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Created volume successfully. Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Flow 'volume_create_manager' (bf6ca4c9-d4cb-4345-9046-12f6aefaf833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29054569-89d5-4592-afb4-793bb61ceb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29054569-89d5-4592-afb4-793bb61ceb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-879484130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80983629-a45e-433c-a755-bbe616dcc29c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b9e87f17fe49d8a6a8a5055b8f4e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:05Z,use_quota=True,user_id='220a7813b69b41ae8b4a5c04dc314848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28084874-1f5e-4a75-b2bc-0653748f67c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28084874-1f5e-4a75-b2bc-0653748f67c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbcf8e30-bba2-4b25-bc2a-1db989129c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbcf8e30-bba2-4b25-bc2a-1db989129c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80983629-a45e-433c-a755-bbe616dcc29c', 'volume_name': 'volume-80983629-a45e-433c-a755-bbe616dcc29c', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615d389b-39ff-4e0b-8895-a70e29160f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615d389b-39ff-4e0b-8895-a70e29160f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f945ec0-88ee-4850-ad30-569e960a1465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:05 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Volume 80983629-a45e-433c-a755-bbe616dcc29c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80983629-a45e-433c-a755-bbe616dcc29c', 'volume_size': 1} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-879484130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80983629-a45e-433c-a755-bbe616dcc29c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b9e87f17fe49d8a6a8a5055b8f4e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:05Z,use_quota=True,user_id='220a7813b69b41ae8b4a5c04dc314848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Creating volume 80983629-a45e-433c-a755-bbe616dcc29c {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:05 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-80983629-a45e-433c-a755-bbe616dcc29c 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:05 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-80983629-a45e-433c-a755-bbe616dcc29c 1073741824 Sep 28 17:28:05 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Flow 'volume_create_manager' (2418e4d1-3da1-4628-be6e-fcd036b49f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed09c91-a85a-45c8-90e0-a93b9f4396e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed09c91-a85a-45c8-90e0-a93b9f4396e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1079620122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0210d9a4-97cc-4aa0-8070-1cf900927705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b9e87f17fe49d8a6a8a5055b8f4e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:06Z,use_quota=True,user_id='220a7813b69b41ae8b4a5c04dc314848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51419e92-2b90-419b-ac2b-193fc418fbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51419e92-2b90-419b-ac2b-193fc418fbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c895a29-76f9-423e-8ced-a8fa3dfaff3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c895a29-76f9-423e-8ced-a8fa3dfaff3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0210d9a4-97cc-4aa0-8070-1cf900927705', 'volume_name': 'volume-0210d9a4-97cc-4aa0-8070-1cf900927705', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f85a2f-abaf-42d3-b746-dc2756fd5cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f85a2f-abaf-42d3-b746-dc2756fd5cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4193949-bca0-48d1-91e6-800ac6e3cb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:05 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Volume 0210d9a4-97cc-4aa0-8070-1cf900927705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0210d9a4-97cc-4aa0-8070-1cf900927705', 'volume_size': 1} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:05 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-80983629-a45e-433c-a755-bbe616dcc29c 1073741824" returned: 0 in 0.555s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-80983629-a45e-433c-a755-bbe616dcc29c {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:05 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-80983629-a45e-433c-a755-bbe616dcc29c Sep 28 17:28:05 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Flow 'volume_create_manager' (b3dc774f-1aa4-4b47-8eae-6d7314caf3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f00e92-237b-4731-a1eb-8ab6b5a024ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f00e92-237b-4731-a1eb-8ab6b5a024ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1570422997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae3e48f-6503-4db7-ad11-9ccc405cfe53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b9e87f17fe49d8a6a8a5055b8f4e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:06Z,use_quota=True,user_id='220a7813b69b41ae8b4a5c04dc314848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a6efec-e5dd-4a2a-8aac-cd66f8f3649d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a6efec-e5dd-4a2a-8aac-cd66f8f3649d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97b1b98-1231-4e75-ab8f-324987cfcf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97b1b98-1231-4e75-ab8f-324987cfcf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eae3e48f-6503-4db7-ad11-9ccc405cfe53', 'volume_name': 'volume-eae3e48f-6503-4db7-ad11-9ccc405cfe53', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01db503-6ac7-4768-8e8c-03f754aac6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01db503-6ac7-4768-8e8c-03f754aac6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e00ddf-61fd-49ad-ac86-efc2e0a3fad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:06 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Volume eae3e48f-6503-4db7-ad11-9ccc405cfe53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eae3e48f-6503-4db7-ad11-9ccc405cfe53', 'volume_size': 1} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:06 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-80983629-a45e-433c-a755-bbe616dcc29c" returned: 0 in 0.330s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.558s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1079620122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0210d9a4-97cc-4aa0-8070-1cf900927705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b9e87f17fe49d8a6a8a5055b8f4e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:06Z,use_quota=True,user_id='220a7813b69b41ae8b4a5c04dc314848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Creating volume 0210d9a4-97cc-4aa0-8070-1cf900927705 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:06 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0210d9a4-97cc-4aa0-8070-1cf900927705 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f945ec0-88ee-4850-ad30-569e960a1465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80983629-a45e-433c-a755-bbe616dcc29c', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:06 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0210d9a4-97cc-4aa0-8070-1cf900927705 1073741824 Sep 28 17:28:06 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2e82dc-267f-4c77-bc82-2895ca3b3e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:06 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Volume volume-80983629-a45e-433c-a755-bbe616dcc29c (80983629-a45e-433c-a755-bbe616dcc29c): created successfully Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2e82dc-267f-4c77-bc82-2895ca3b3e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Flow 'volume_create_manager' (bf6ca4c9-d4cb-4345-9046-12f6aefaf833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:06 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-943b3488-a201-4b25-a8dc-c3cbc7d62dea tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Created volume successfully. Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Flow 'volume_create_manager' (98a6f871-857f-4070-9192-b6fea517b60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244da0bd-a287-42fe-b114-2b1ec7bbc179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244da0bd-a287-42fe-b114-2b1ec7bbc179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1410964962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57549503-bcfc-4996-a3a1-963aee042cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b9e87f17fe49d8a6a8a5055b8f4e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:06Z,use_quota=True,user_id='220a7813b69b41ae8b4a5c04dc314848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f53d08-8f65-46bd-8e2b-ff1666428be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f53d08-8f65-46bd-8e2b-ff1666428be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42050749-ed5b-4225-b6b6-3cb683112b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42050749-ed5b-4225-b6b6-3cb683112b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57549503-bcfc-4996-a3a1-963aee042cc1', 'volume_name': 'volume-57549503-bcfc-4996-a3a1-963aee042cc1', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a91b248-3f0b-4b75-9e90-7e2b65b3f438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a91b248-3f0b-4b75-9e90-7e2b65b3f438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555c4aa4-4f38-40a0-9a50-00c69c7e6199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:06 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Volume 57549503-bcfc-4996-a3a1-963aee042cc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57549503-bcfc-4996-a3a1-963aee042cc1', 'volume_size': 1} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:06 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0210d9a4-97cc-4aa0-8070-1cf900927705 1073741824" returned: 0 in 0.570s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:06 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:28:06 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0210d9a4-97cc-4aa0-8070-1cf900927705 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:06 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0210d9a4-97cc-4aa0-8070-1cf900927705 Sep 28 17:28:06 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Flow 'volume_create_manager' (b9ab50d7-75ba-42fa-958a-dfdbc18cc0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3752cde-28e1-429a-b821-70aca3b97f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3752cde-28e1-429a-b821-70aca3b97f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1934612919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da38fe15-4f3e-4e61-bb5a-364885f25f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b9e87f17fe49d8a6a8a5055b8f4e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:07Z,use_quota=True,user_id='220a7813b69b41ae8b4a5c04dc314848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335d922f-01f0-456a-b18c-1f0abc96dd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335d922f-01f0-456a-b18c-1f0abc96dd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6e80bb-1ae9-4b37-8bba-6d220f4d8e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6e80bb-1ae9-4b37-8bba-6d220f4d8e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da38fe15-4f3e-4e61-bb5a-364885f25f2d', 'volume_name': 'volume-da38fe15-4f3e-4e61-bb5a-364885f25f2d', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abf164cb-2f87-400b-ac3e-16b2193eaa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abf164cb-2f87-400b-ac3e-16b2193eaa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b387627c-2d80-42d9-9e66-a7131b55c774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:07 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Volume da38fe15-4f3e-4e61-bb5a-364885f25f2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da38fe15-4f3e-4e61-bb5a-364885f25f2d', 'volume_size': 1} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:07 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.392s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:28:07 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0210d9a4-97cc-4aa0-8070-1cf900927705" returned: 0 in 0.311s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.058s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1570422997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae3e48f-6503-4db7-ad11-9ccc405cfe53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b9e87f17fe49d8a6a8a5055b8f4e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:06Z,use_quota=True,user_id='220a7813b69b41ae8b4a5c04dc314848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Creating volume eae3e48f-6503-4db7-ad11-9ccc405cfe53 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:07 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eae3e48f-6503-4db7-ad11-9ccc405cfe53 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4193949-bca0-48d1-91e6-800ac6e3cb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0210d9a4-97cc-4aa0-8070-1cf900927705', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9324f5-08a2-40d6-a582-c1ec75d4ae82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:07 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eae3e48f-6503-4db7-ad11-9ccc405cfe53 1073741824 Sep 28 17:28:07 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:07 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Volume volume-0210d9a4-97cc-4aa0-8070-1cf900927705 (0210d9a4-97cc-4aa0-8070-1cf900927705): created successfully Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9324f5-08a2-40d6-a582-c1ec75d4ae82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Flow 'volume_create_manager' (2418e4d1-3da1-4628-be6e-fcd036b49f3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:07 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-8798dc19-2f3f-4e95-8fa5-5710b4b7a624 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Created volume successfully. Sep 28 17:28:07 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eae3e48f-6503-4db7-ad11-9ccc405cfe53 1073741824" returned: 0 in 0.453s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eae3e48f-6503-4db7-ad11-9ccc405cfe53 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:07 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eae3e48f-6503-4db7-ad11-9ccc405cfe53 Sep 28 17:28:07 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:07 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eae3e48f-6503-4db7-ad11-9ccc405cfe53" returned: 0 in 0.265s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.366s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1410964962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57549503-bcfc-4996-a3a1-963aee042cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b9e87f17fe49d8a6a8a5055b8f4e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:06Z,use_quota=True,user_id='220a7813b69b41ae8b4a5c04dc314848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Creating volume 57549503-bcfc-4996-a3a1-963aee042cc1 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:07 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:08 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-57549503-bcfc-4996-a3a1-963aee042cc1 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e00ddf-61fd-49ad-ac86-efc2e0a3fad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eae3e48f-6503-4db7-ad11-9ccc405cfe53', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93424985-5ec7-4339-92a3-083f347b18c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:08 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-57549503-bcfc-4996-a3a1-963aee042cc1 1073741824 Sep 28 17:28:08 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:08 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Volume volume-eae3e48f-6503-4db7-ad11-9ccc405cfe53 (eae3e48f-6503-4db7-ad11-9ccc405cfe53): created successfully Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93424985-5ec7-4339-92a3-083f347b18c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Flow 'volume_create_manager' (b3dc774f-1aa4-4b47-8eae-6d7314caf3ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:08 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-120606a8-c743-4c9c-91a5-b05d92eaad2f tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Created volume successfully. Sep 28 17:28:08 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-57549503-bcfc-4996-a3a1-963aee042cc1 1073741824" returned: 0 in 0.466s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-57549503-bcfc-4996-a3a1-963aee042cc1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:08 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-57549503-bcfc-4996-a3a1-963aee042cc1 Sep 28 17:28:08 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:08 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-57549503-bcfc-4996-a3a1-963aee042cc1" returned: 0 in 0.269s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.631s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1934612919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da38fe15-4f3e-4e61-bb5a-364885f25f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b9e87f17fe49d8a6a8a5055b8f4e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:07Z,use_quota=True,user_id='220a7813b69b41ae8b4a5c04dc314848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Creating volume da38fe15-4f3e-4e61-bb5a-364885f25f2d {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:08 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-da38fe15-4f3e-4e61-bb5a-364885f25f2d 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:08 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-da38fe15-4f3e-4e61-bb5a-364885f25f2d 1073741824 Sep 28 17:28:08 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555c4aa4-4f38-40a0-9a50-00c69c7e6199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57549503-bcfc-4996-a3a1-963aee042cc1', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0b27da-209b-4559-9435-e682bcaee00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:08 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Volume volume-57549503-bcfc-4996-a3a1-963aee042cc1 (57549503-bcfc-4996-a3a1-963aee042cc1): created successfully Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0b27da-209b-4559-9435-e682bcaee00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Flow 'volume_create_manager' (98a6f871-857f-4070-9192-b6fea517b60e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:08 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-32e66d33-03cb-4a78-8282-bcad335b025d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Created volume successfully. Sep 28 17:28:09 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-da38fe15-4f3e-4e61-bb5a-364885f25f2d 1073741824" returned: 0 in 0.509s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-da38fe15-4f3e-4e61-bb5a-364885f25f2d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:09 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-da38fe15-4f3e-4e61-bb5a-364885f25f2d Sep 28 17:28:09 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:09 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-da38fe15-4f3e-4e61-bb5a-364885f25f2d" returned: 0 in 0.295s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b387627c-2d80-42d9-9e66-a7131b55c774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da38fe15-4f3e-4e61-bb5a-364885f25f2d', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c26666-8c72-472e-87e3-97559bab4530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:09 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Volume volume-da38fe15-4f3e-4e61-bb5a-364885f25f2d (da38fe15-4f3e-4e61-bb5a-364885f25f2d): created successfully Sep 28 17:28:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c26666-8c72-472e-87e3-97559bab4530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Flow 'volume_create_manager' (b9ab50d7-75ba-42fa-958a-dfdbc18cc0c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:09 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-3e9baa23-281a-45fe-a2c7-76df0ebfd7e3 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Created volume successfully. Sep 28 17:28:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-18370205-da19-4724-9fae-0650f36356d4 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "cinder-da38fe15-4f3e-4e61-bb5a-364885f25f2d-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-18370205-da19-4724-9fae-0650f36356d4 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-da38fe15-4f3e-4e61-bb5a-364885f25f2d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-18370205-da19-4724-9fae-0650f36356d4 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "cinder-quobyte-da38fe15-4f3e-4e61-bb5a-364885f25f2d" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-18370205-da19-4724-9fae-0650f36356d4 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-quobyte-da38fe15-4f3e-4e61-bb5a-364885f25f2d" acquired by "delete_volume" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:10 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8a5ace-d19f-4d07-b811-3abe262c5b22]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-18370205-da19-4724-9fae-0650f36356d4 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-da38fe15-4f3e-4e61-bb5a-364885f25f2d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:10 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-da38fe15-4f3e-4e61-bb5a-364885f25f2d Sep 28 17:28:10 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:10 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-18370205-da19-4724-9fae-0650f36356d4 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-da38fe15-4f3e-4e61-bb5a-364885f25f2d" returned: 0 in 0.390s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-18370205-da19-4724-9fae-0650f36356d4 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-da38fe15-4f3e-4e61-bb5a-364885f25f2d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:11 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-da38fe15-4f3e-4e61-bb5a-364885f25f2d Sep 28 17:28:11 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:11 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-18370205-da19-4724-9fae-0650f36356d4 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-da38fe15-4f3e-4e61-bb5a-364885f25f2d" returned: 0 in 0.273s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-18370205-da19-4724-9fae-0650f36356d4 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-quobyte-da38fe15-4f3e-4e61-bb5a-364885f25f2d" released by "delete_volume" :: held 0.711s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:11 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-18370205-da19-4724-9fae-0650f36356d4 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Created reservations ['eef261ff-a362-4f76-8b08-346290054489', 'b019aa9b-97d0-45ec-96c4-82e22e00483e', '69be47d6-176b-421d-9829-271b1bfe0554', 'a2c8d059-beb3-4723-8b13-c1faa3783c2e'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-18370205-da19-4724-9fae-0650f36356d4 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-18370205-da19-4724-9fae-0650f36356d4 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-18370205-da19-4724-9fae-0650f36356d4 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-18370205-da19-4724-9fae-0650f36356d4 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-18370205-da19-4724-9fae-0650f36356d4 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-18370205-da19-4724-9fae-0650f36356d4 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:11 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:28:11 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:11 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f6b0e55a-5721-45b7-85f6-22d6e864877b tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "cinder-57549503-bcfc-4996-a3a1-963aee042cc1-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-18370205-da19-4724-9fae-0650f36356d4 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.292s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:11 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-18370205-da19-4724-9fae-0650f36356d4 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:11 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-18370205-da19-4724-9fae-0650f36356d4 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Deleted volume successfully. Sep 28 17:28:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f6b0e55a-5721-45b7-85f6-22d6e864877b tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-57549503-bcfc-4996-a3a1-963aee042cc1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-18370205-da19-4724-9fae-0650f36356d4 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-da38fe15-4f3e-4e61-bb5a-364885f25f2d-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f6b0e55a-5721-45b7-85f6-22d6e864877b tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "cinder-quobyte-57549503-bcfc-4996-a3a1-963aee042cc1" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f6b0e55a-5721-45b7-85f6-22d6e864877b tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-quobyte-57549503-bcfc-4996-a3a1-963aee042cc1" acquired by "delete_volume" :: waited 0.017s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:11 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2a45a9-8643-4f44-856e-776663435fcc]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f6b0e55a-5721-45b7-85f6-22d6e864877b tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-57549503-bcfc-4996-a3a1-963aee042cc1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:11 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-57549503-bcfc-4996-a3a1-963aee042cc1 Sep 28 17:28:11 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:12 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f6b0e55a-5721-45b7-85f6-22d6e864877b tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-57549503-bcfc-4996-a3a1-963aee042cc1" returned: 0 in 0.435s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f6b0e55a-5721-45b7-85f6-22d6e864877b tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-57549503-bcfc-4996-a3a1-963aee042cc1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:12 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-57549503-bcfc-4996-a3a1-963aee042cc1 Sep 28 17:28:12 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:12 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f6b0e55a-5721-45b7-85f6-22d6e864877b tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-57549503-bcfc-4996-a3a1-963aee042cc1" returned: 0 in 0.281s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f6b0e55a-5721-45b7-85f6-22d6e864877b tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-quobyte-57549503-bcfc-4996-a3a1-963aee042cc1" released by "delete_volume" :: held 0.761s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:12 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-f6b0e55a-5721-45b7-85f6-22d6e864877b tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Created reservations ['b65bb036-1cba-483d-8a4c-55d5ff0659eb', 'e493a675-8582-4eb7-99c0-5781ca1c2ec1', '7f5dd591-847b-434d-be24-005b77c1562f', 'a9223cf9-b9c5-402a-90d0-2e985e338065'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f6b0e55a-5721-45b7-85f6-22d6e864877b tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f6b0e55a-5721-45b7-85f6-22d6e864877b tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f6b0e55a-5721-45b7-85f6-22d6e864877b tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f6b0e55a-5721-45b7-85f6-22d6e864877b tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f6b0e55a-5721-45b7-85f6-22d6e864877b tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f6b0e55a-5721-45b7-85f6-22d6e864877b tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:12 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:28:12 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d0829be1-f0c0-484c-aff0-9b935ef3d900 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "cinder-eae3e48f-6503-4db7-ad11-9ccc405cfe53-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d0829be1-f0c0-484c-aff0-9b935ef3d900 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-eae3e48f-6503-4db7-ad11-9ccc405cfe53-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d0829be1-f0c0-484c-aff0-9b935ef3d900 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "cinder-quobyte-eae3e48f-6503-4db7-ad11-9ccc405cfe53" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d0829be1-f0c0-484c-aff0-9b935ef3d900 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-quobyte-eae3e48f-6503-4db7-ad11-9ccc405cfe53" acquired by "delete_volume" :: waited 0.017s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:13 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f6b0e55a-5721-45b7-85f6-22d6e864877b tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.337s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:13 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-f6b0e55a-5721-45b7-85f6-22d6e864877b tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:13 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f141a8-4535-4ae2-9fe7-eb9aecbaa1ee]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0829be1-f0c0-484c-aff0-9b935ef3d900 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eae3e48f-6503-4db7-ad11-9ccc405cfe53 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:13 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-f6b0e55a-5721-45b7-85f6-22d6e864877b tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Deleted volume successfully. Sep 28 17:28:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f6b0e55a-5721-45b7-85f6-22d6e864877b tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-57549503-bcfc-4996-a3a1-963aee042cc1-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:13 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eae3e48f-6503-4db7-ad11-9ccc405cfe53 Sep 28 17:28:13 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:13 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0829be1-f0c0-484c-aff0-9b935ef3d900 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eae3e48f-6503-4db7-ad11-9ccc405cfe53" returned: 0 in 0.406s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0829be1-f0c0-484c-aff0-9b935ef3d900 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eae3e48f-6503-4db7-ad11-9ccc405cfe53 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:13 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eae3e48f-6503-4db7-ad11-9ccc405cfe53 Sep 28 17:28:13 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:13 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0829be1-f0c0-484c-aff0-9b935ef3d900 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-eae3e48f-6503-4db7-ad11-9ccc405cfe53" returned: 0 in 0.275s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d0829be1-f0c0-484c-aff0-9b935ef3d900 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-quobyte-eae3e48f-6503-4db7-ad11-9ccc405cfe53" released by "delete_volume" :: held 0.752s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:13 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-d0829be1-f0c0-484c-aff0-9b935ef3d900 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Created reservations ['ab0ead82-3402-48b4-a3ca-d8f974cb3f9f', '909d372b-50da-4bed-8950-3df924be0961', '162bd46c-066b-4d65-94fc-94e4eaf23e6c', 'a7019e43-6bd3-426c-96be-5214e4131cae'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d0829be1-f0c0-484c-aff0-9b935ef3d900 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d0829be1-f0c0-484c-aff0-9b935ef3d900 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:13 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d0829be1-f0c0-484c-aff0-9b935ef3d900 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:13 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d0829be1-f0c0-484c-aff0-9b935ef3d900 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d0829be1-f0c0-484c-aff0-9b935ef3d900 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0829be1-f0c0-484c-aff0-9b935ef3d900 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:13 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:28:13 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-dcfd63c8-3319-4742-9c1b-22cc34d8a249 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "cinder-0210d9a4-97cc-4aa0-8070-1cf900927705-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-dcfd63c8-3319-4742-9c1b-22cc34d8a249 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-0210d9a4-97cc-4aa0-8070-1cf900927705-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:14 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-dcfd63c8-3319-4742-9c1b-22cc34d8a249 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "cinder-quobyte-0210d9a4-97cc-4aa0-8070-1cf900927705" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d0829be1-f0c0-484c-aff0-9b935ef3d900 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.347s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:14 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-d0829be1-f0c0-484c-aff0-9b935ef3d900 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:14 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d0829be1-f0c0-484c-aff0-9b935ef3d900 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Deleted volume successfully. Sep 28 17:28:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-dcfd63c8-3319-4742-9c1b-22cc34d8a249 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-quobyte-0210d9a4-97cc-4aa0-8070-1cf900927705" acquired by "delete_volume" :: waited 0.025s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d0829be1-f0c0-484c-aff0-9b935ef3d900 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-eae3e48f-6503-4db7-ad11-9ccc405cfe53-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:14 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[136096fe-2897-4b6f-9ba1-d858f7feb1a9]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dcfd63c8-3319-4742-9c1b-22cc34d8a249 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0210d9a4-97cc-4aa0-8070-1cf900927705 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:14 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0210d9a4-97cc-4aa0-8070-1cf900927705 Sep 28 17:28:14 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:14 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dcfd63c8-3319-4742-9c1b-22cc34d8a249 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0210d9a4-97cc-4aa0-8070-1cf900927705" returned: 0 in 0.374s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dcfd63c8-3319-4742-9c1b-22cc34d8a249 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0210d9a4-97cc-4aa0-8070-1cf900927705 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:14 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0210d9a4-97cc-4aa0-8070-1cf900927705 Sep 28 17:28:14 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:14 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dcfd63c8-3319-4742-9c1b-22cc34d8a249 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-0210d9a4-97cc-4aa0-8070-1cf900927705" returned: 0 in 0.297s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-dcfd63c8-3319-4742-9c1b-22cc34d8a249 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-quobyte-0210d9a4-97cc-4aa0-8070-1cf900927705" released by "delete_volume" :: held 0.717s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:15 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-dcfd63c8-3319-4742-9c1b-22cc34d8a249 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Created reservations ['1b288113-2251-4afd-a5aa-8e9542311778', '995df4c6-5a3a-42a1-9a53-ed623db24585', '8c15603c-644f-448d-a47a-cfeec539e9cd', '46c0f349-3a2a-4889-9569-326b55bcae14'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-dcfd63c8-3319-4742-9c1b-22cc34d8a249 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-dcfd63c8-3319-4742-9c1b-22cc34d8a249 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:15 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-dcfd63c8-3319-4742-9c1b-22cc34d8a249 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:15 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-dcfd63c8-3319-4742-9c1b-22cc34d8a249 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-dcfd63c8-3319-4742-9c1b-22cc34d8a249 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dcfd63c8-3319-4742-9c1b-22cc34d8a249 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:15 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:28:15 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f1a6b94f-7f9d-421f-b0f2-79c25f95981d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "cinder-80983629-a45e-433c-a755-bbe616dcc29c-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f1a6b94f-7f9d-421f-b0f2-79c25f95981d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-80983629-a45e-433c-a755-bbe616dcc29c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f1a6b94f-7f9d-421f-b0f2-79c25f95981d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "cinder-quobyte-80983629-a45e-433c-a755-bbe616dcc29c" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f1a6b94f-7f9d-421f-b0f2-79c25f95981d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-quobyte-80983629-a45e-433c-a755-bbe616dcc29c" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:15 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dcfd63c8-3319-4742-9c1b-22cc34d8a249 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.318s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:15 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-dcfd63c8-3319-4742-9c1b-22cc34d8a249 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:15 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-dcfd63c8-3319-4742-9c1b-22cc34d8a249 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Deleted volume successfully. Sep 28 17:28:15 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[271a7fd9-82a9-46cd-b7f6-f4d4af9da08e]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f1a6b94f-7f9d-421f-b0f2-79c25f95981d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-80983629-a45e-433c-a755-bbe616dcc29c {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-dcfd63c8-3319-4742-9c1b-22cc34d8a249 tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-0210d9a4-97cc-4aa0-8070-1cf900927705-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:15 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-80983629-a45e-433c-a755-bbe616dcc29c Sep 28 17:28:15 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:15 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f1a6b94f-7f9d-421f-b0f2-79c25f95981d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-80983629-a45e-433c-a755-bbe616dcc29c" returned: 0 in 0.401s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f1a6b94f-7f9d-421f-b0f2-79c25f95981d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-80983629-a45e-433c-a755-bbe616dcc29c {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:15 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-80983629-a45e-433c-a755-bbe616dcc29c Sep 28 17:28:15 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:16 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f1a6b94f-7f9d-421f-b0f2-79c25f95981d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-80983629-a45e-433c-a755-bbe616dcc29c" returned: 0 in 0.264s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f1a6b94f-7f9d-421f-b0f2-79c25f95981d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-quobyte-80983629-a45e-433c-a755-bbe616dcc29c" released by "delete_volume" :: held 0.725s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:16 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-f1a6b94f-7f9d-421f-b0f2-79c25f95981d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Created reservations ['dec43360-30a1-495d-a049-968644b2a8a6', '2649efa6-78dc-4350-8539-e768f7bd6196', '457d0aa0-ba25-401d-8181-a03ee01075a0', 'f8670939-d7dc-40c7-950b-0b79990800f5'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f1a6b94f-7f9d-421f-b0f2-79c25f95981d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f1a6b94f-7f9d-421f-b0f2-79c25f95981d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f1a6b94f-7f9d-421f-b0f2-79c25f95981d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f1a6b94f-7f9d-421f-b0f2-79c25f95981d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f1a6b94f-7f9d-421f-b0f2-79c25f95981d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f1a6b94f-7f9d-421f-b0f2-79c25f95981d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:16 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:28:16 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c6e0201c-fa4a-4760-b962-3f0366cfcb9d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "cinder-1df9dd72-0ce6-4307-9451-f198dfa5eb1d-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:16 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f1a6b94f-7f9d-421f-b0f2-79c25f95981d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.274s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:16 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-f1a6b94f-7f9d-421f-b0f2-79c25f95981d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c6e0201c-fa4a-4760-b962-3f0366cfcb9d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-1df9dd72-0ce6-4307-9451-f198dfa5eb1d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:16 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-f1a6b94f-7f9d-421f-b0f2-79c25f95981d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Deleted volume successfully. Sep 28 17:28:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f1a6b94f-7f9d-421f-b0f2-79c25f95981d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-80983629-a45e-433c-a755-bbe616dcc29c-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c6e0201c-fa4a-4760-b962-3f0366cfcb9d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "cinder-quobyte-1df9dd72-0ce6-4307-9451-f198dfa5eb1d" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c6e0201c-fa4a-4760-b962-3f0366cfcb9d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-quobyte-1df9dd72-0ce6-4307-9451-f198dfa5eb1d" acquired by "delete_volume" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:16 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32ea87f-d88f-461b-b254-2e7b81b80781]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c6e0201c-fa4a-4760-b962-3f0366cfcb9d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1df9dd72-0ce6-4307-9451-f198dfa5eb1d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:16 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1df9dd72-0ce6-4307-9451-f198dfa5eb1d Sep 28 17:28:16 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:17 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c6e0201c-fa4a-4760-b962-3f0366cfcb9d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1df9dd72-0ce6-4307-9451-f198dfa5eb1d" returned: 0 in 0.436s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c6e0201c-fa4a-4760-b962-3f0366cfcb9d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1df9dd72-0ce6-4307-9451-f198dfa5eb1d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:17 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1df9dd72-0ce6-4307-9451-f198dfa5eb1d Sep 28 17:28:17 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:17 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c6e0201c-fa4a-4760-b962-3f0366cfcb9d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-1df9dd72-0ce6-4307-9451-f198dfa5eb1d" returned: 0 in 0.291s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c6e0201c-fa4a-4760-b962-3f0366cfcb9d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-quobyte-1df9dd72-0ce6-4307-9451-f198dfa5eb1d" released by "delete_volume" :: held 0.782s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:17 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-c6e0201c-fa4a-4760-b962-3f0366cfcb9d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Created reservations ['ebfd7bdf-bb7f-4bc9-a37a-bb266ca3049b', 'afbe9cba-0ae3-4fc8-9daa-68fbf35e09ae', '69f2fab5-84c2-4f22-8f62-470975d10e58', 'af457262-eccb-4321-933d-33b0ab3ef197'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c6e0201c-fa4a-4760-b962-3f0366cfcb9d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c6e0201c-fa4a-4760-b962-3f0366cfcb9d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c6e0201c-fa4a-4760-b962-3f0366cfcb9d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c6e0201c-fa4a-4760-b962-3f0366cfcb9d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c6e0201c-fa4a-4760-b962-3f0366cfcb9d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c6e0201c-fa4a-4760-b962-3f0366cfcb9d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:17 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:28:17 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:17 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c6e0201c-fa4a-4760-b962-3f0366cfcb9d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.290s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:17 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-c6e0201c-fa4a-4760-b962-3f0366cfcb9d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:17 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-c6e0201c-fa4a-4760-b962-3f0366cfcb9d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Deleted volume successfully. Sep 28 17:28:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-c6e0201c-fa4a-4760-b962-3f0366cfcb9d tempest-CreateVolumesFromSourceVolumeTest-566738725 None] Lock "cinder-1df9dd72-0ce6-4307-9451-f198dfa5eb1d-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:27 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:UPDATE=79,cinder:SELECT=54,cinder:INSERT=24,cinder:DELETE=10 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:28:27 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=56,cinder:INSERT=21,cinder:UPDATE=78,cinder:DELETE=4 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:28:34 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Flow 'volume_create_manager' (07426ae7-041f-47b4-9f4c-69bb8517d77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600dcfbf-95a2-43ab-82b4-723e18a55543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600dcfbf-95a2-43ab-82b4-723e18a55543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1952133553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=245e47ab-5cd0-46a0-9031-7c8f8206d102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f5bb6a23280467585aeb3b03a29b4de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:35Z,use_quota=True,user_id='933042ff6f50431fb36dd8ba51204e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aecd02b-c86f-4313-a09e-a4a518a10470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:34 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aecd02b-c86f-4313-a09e-a4a518a10470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d600d1da-5c0a-4a2d-91cd-346cc0ebc18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d600d1da-5c0a-4a2d-91cd-346cc0ebc18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '245e47ab-5cd0-46a0-9031-7c8f8206d102', 'volume_name': 'volume-245e47ab-5cd0-46a0-9031-7c8f8206d102', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c1caaf-0b35-4b30-9964-2817b764f4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c1caaf-0b35-4b30-9964-2817b764f4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8353d5c0-a09b-40de-a495-473662a93165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Volume 245e47ab-5cd0-46a0-9031-7c8f8206d102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-245e47ab-5cd0-46a0-9031-7c8f8206d102', 'volume_size': 1} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1952133553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=245e47ab-5cd0-46a0-9031-7c8f8206d102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f5bb6a23280467585aeb3b03a29b4de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:35Z,use_quota=True,user_id='933042ff6f50431fb36dd8ba51204e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Creating volume 245e47ab-5cd0-46a0-9031-7c8f8206d102 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:35 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-245e47ab-5cd0-46a0-9031-7c8f8206d102 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:35 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-245e47ab-5cd0-46a0-9031-7c8f8206d102 1073741824 Sep 28 17:28:35 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Flow 'volume_create_manager' (9e819299-8a40-43e7-9462-4b4d9ac90759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cf68aef-4741-4a0d-b7fc-05867b816db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cf68aef-4741-4a0d-b7fc-05867b816db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-68571030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5379e968-ad3c-4404-a6a9-c1a2a2312415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d8463010cb4ad996ec1e17140bfa08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:35Z,use_quota=True,user_id='0b560e96d117438289613d5f807e131a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3af24df-edf3-46e7-b2bc-93d76068aef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3af24df-edf3-46e7-b2bc-93d76068aef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31cac572-d650-46c2-943c-921dd14ee684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31cac572-d650-46c2-943c-921dd14ee684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5379e968-ad3c-4404-a6a9-c1a2a2312415', 'volume_name': 'volume-5379e968-ad3c-4404-a6a9-c1a2a2312415', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e8556a0-027c-4db8-8fc6-b73f81d76cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e8556a0-027c-4db8-8fc6-b73f81d76cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51cefa98-24b2-456f-88ca-b49c71c9593e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Volume 5379e968-ad3c-4404-a6a9-c1a2a2312415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5379e968-ad3c-4404-a6a9-c1a2a2312415', 'volume_size': 1} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Flow 'volume_create_manager' (9ae2b7c4-80d7-421e-8635-2f082efa82d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07e5388-f10c-4de2-b4b7-b193014ec704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07e5388-f10c-4de2-b4b7-b193014ec704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1880744749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6a8175-6279-4f09-881b-02a667802dfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f5bb6a23280467585aeb3b03a29b4de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:35Z,use_quota=True,user_id='933042ff6f50431fb36dd8ba51204e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a04b5e8-cd4f-4b32-8ee3-f6f0143b9820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a04b5e8-cd4f-4b32-8ee3-f6f0143b9820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047c7241-b9e5-4881-930e-9680ca79b81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047c7241-b9e5-4881-930e-9680ca79b81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe6a8175-6279-4f09-881b-02a667802dfd', 'volume_name': 'volume-fe6a8175-6279-4f09-881b-02a667802dfd', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735cc611-4628-4a36-b424-9afbce800ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735cc611-4628-4a36-b424-9afbce800ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9003999f-be50-4c0c-a293-447303746bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Volume fe6a8175-6279-4f09-881b-02a667802dfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe6a8175-6279-4f09-881b-02a667802dfd', 'volume_size': 1} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Flow 'volume_create_manager' (0f4d03a1-c279-4ae0-a618-a445d4b3bc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d051b6b-1c4a-4cb4-9a7f-59d38c1de733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d051b6b-1c4a-4cb4-9a7f-59d38c1de733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1468979157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5297b106-bd9d-495f-92f4-93494e1fef80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f5bb6a23280467585aeb3b03a29b4de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:35Z,use_quota=True,user_id='933042ff6f50431fb36dd8ba51204e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c416cdc5-2bce-4a7b-a551-1ca5832c3836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c416cdc5-2bce-4a7b-a551-1ca5832c3836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3b867a-cbe9-448e-82cb-de90a9536c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3b867a-cbe9-448e-82cb-de90a9536c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5297b106-bd9d-495f-92f4-93494e1fef80', 'volume_name': 'volume-5297b106-bd9d-495f-92f4-93494e1fef80', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3955dc77-28ab-4b4b-8766-df24ce13409c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3955dc77-28ab-4b4b-8766-df24ce13409c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf620e7-25c4-4e59-9a93-15ce5f294c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Volume 5297b106-bd9d-495f-92f4-93494e1fef80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5297b106-bd9d-495f-92f4-93494e1fef80', 'volume_size': 1} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:35 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-245e47ab-5cd0-46a0-9031-7c8f8206d102 1073741824" returned: 0 in 0.770s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-245e47ab-5cd0-46a0-9031-7c8f8206d102 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:35 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-245e47ab-5cd0-46a0-9031-7c8f8206d102 Sep 28 17:28:36 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Flow 'volume_create_manager' (ffd201a4-9404-407e-ad3b-61377c9398d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff7a798-5846-4ba5-b900-29208afd9732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:36 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-245e47ab-5cd0-46a0-9031-7c8f8206d102" returned: 0 in 0.441s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.091s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-68571030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5379e968-ad3c-4404-a6a9-c1a2a2312415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d8463010cb4ad996ec1e17140bfa08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:35Z,use_quota=True,user_id='0b560e96d117438289613d5f807e131a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Creating volume 5379e968-ad3c-4404-a6a9-c1a2a2312415 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:36 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff7a798-5846-4ba5-b900-29208afd9732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1914503050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295121d8-2db3-4b63-bfb0-9f3b06324ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f5bb6a23280467585aeb3b03a29b4de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:36Z,use_quota=True,user_id='933042ff6f50431fb36dd8ba51204e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:36 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415 1073741824 Sep 28 17:28:36 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f40734-872e-4036-8023-b221f7b62109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f40734-872e-4036-8023-b221f7b62109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5108f36b-9504-4b04-ba89-4adcea222a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5108f36b-9504-4b04-ba89-4adcea222a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '295121d8-2db3-4b63-bfb0-9f3b06324ba8', 'volume_name': 'volume-295121d8-2db3-4b63-bfb0-9f3b06324ba8', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d340f822-f049-49b9-b1d8-24db7338528f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d340f822-f049-49b9-b1d8-24db7338528f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245daa4c-f4ed-4fcb-8bbc-5426381bd7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:36 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Volume 295121d8-2db3-4b63-bfb0-9f3b06324ba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-295121d8-2db3-4b63-bfb0-9f3b06324ba8', 'volume_size': 1} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8353d5c0-a09b-40de-a495-473662a93165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-245e47ab-5cd0-46a0-9031-7c8f8206d102', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1184a8cc-7d2e-407b-8267-aee9a09b06b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:36 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Volume volume-245e47ab-5cd0-46a0-9031-7c8f8206d102 (245e47ab-5cd0-46a0-9031-7c8f8206d102): created successfully Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1184a8cc-7d2e-407b-8267-aee9a09b06b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Flow 'volume_create_manager' (07426ae7-041f-47b4-9f4c-69bb8517d77a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:36 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-369aed1a-ec71-4dd6-b69a-53b0dc94017e tempest-CreateVolumesFromImageTest-338088606 None] Created volume successfully. Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Flow 'volume_create_manager' (befb96ae-0a7a-4308-8c23-e349a2f0c323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d99ce8-9701-4a13-89f9-2a87925e854a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d99ce8-9701-4a13-89f9-2a87925e854a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1004045653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f9e833-858f-446e-a7e6-e69ecd6dc9ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f5bb6a23280467585aeb3b03a29b4de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:37Z,use_quota=True,user_id='933042ff6f50431fb36dd8ba51204e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ead9f4-eb92-4ace-861d-db7c3b76baf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ead9f4-eb92-4ace-861d-db7c3b76baf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36df2907-add6-476f-ab54-265fcc82865a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36df2907-add6-476f-ab54-265fcc82865a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86f9e833-858f-446e-a7e6-e69ecd6dc9ae', 'volume_name': 'volume-86f9e833-858f-446e-a7e6-e69ecd6dc9ae', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8479cf0f-4370-432f-bdf6-ef43ee970b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8479cf0f-4370-432f-bdf6-ef43ee970b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d38cc4-e8f0-401a-a4c1-ab30f4eb690a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:36 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Volume 86f9e833-858f-446e-a7e6-e69ecd6dc9ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86f9e833-858f-446e-a7e6-e69ecd6dc9ae', 'volume_size': 1} Sep 28 17:28:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:37 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415 1073741824" returned: 0 in 0.653s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:37 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415 Sep 28 17:28:37 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:37 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415" returned: 0 in 0.288s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.964s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1880744749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6a8175-6279-4f09-881b-02a667802dfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f5bb6a23280467585aeb3b03a29b4de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:35Z,use_quota=True,user_id='933042ff6f50431fb36dd8ba51204e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Creating volume fe6a8175-6279-4f09-881b-02a667802dfd {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:37 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:28:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fe6a8175-6279-4f09-881b-02a667802dfd 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51cefa98-24b2-456f-88ca-b49c71c9593e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5379e968-ad3c-4404-a6a9-c1a2a2312415', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42412ca-c7e7-4004-97e1-da33e1185688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:37 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fe6a8175-6279-4f09-881b-02a667802dfd 1073741824 Sep 28 17:28:37 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:37 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Volume volume-5379e968-ad3c-4404-a6a9-c1a2a2312415 (5379e968-ad3c-4404-a6a9-c1a2a2312415): created successfully Sep 28 17:28:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42412ca-c7e7-4004-97e1-da33e1185688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:37 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Flow 'volume_create_manager' (9e819299-8a40-43e7-9462-4b4d9ac90759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:37 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-69488827-fce8-47da-9605-08d1645c938c tempest-CreateVolumesFromSnapshotTest-1297301981 None] Created volume successfully. Sep 28 17:28:38 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fe6a8175-6279-4f09-881b-02a667802dfd 1073741824" returned: 0 in 0.652s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fe6a8175-6279-4f09-881b-02a667802dfd {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:38 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fe6a8175-6279-4f09-881b-02a667802dfd Sep 28 17:28:38 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-6d875ea2-6674-4406-8b34-24e218b48470 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:38 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fe6a8175-6279-4f09-881b-02a667802dfd" returned: 0 in 0.331s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.771s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1468979157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5297b106-bd9d-495f-92f4-93494e1fef80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f5bb6a23280467585aeb3b03a29b4de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:35Z,use_quota=True,user_id='933042ff6f50431fb36dd8ba51204e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Creating volume 5297b106-bd9d-495f-92f4-93494e1fef80 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:38 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:28:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5297b106-bd9d-495f-92f4-93494e1fef80 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9003999f-be50-4c0c-a293-447303746bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe6a8175-6279-4f09-881b-02a667802dfd', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:38 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5297b106-bd9d-495f-92f4-93494e1fef80 1073741824 Sep 28 17:28:38 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0484b8-31d9-4b55-9a1c-ccd105f52450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:38 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Volume volume-fe6a8175-6279-4f09-881b-02a667802dfd (fe6a8175-6279-4f09-881b-02a667802dfd): created successfully Sep 28 17:28:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0484b8-31d9-4b55-9a1c-ccd105f52450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:38 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Flow 'volume_create_manager' (9ae2b7c4-80d7-421e-8635-2f082efa82d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:38 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-12c605d5-ec91-4f48-b339-c015f29f1117 tempest-CreateVolumesFromImageTest-338088606 None] Created volume successfully. Sep 28 17:28:39 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5297b106-bd9d-495f-92f4-93494e1fef80 1073741824" returned: 0 in 0.646s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5297b106-bd9d-495f-92f4-93494e1fef80 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:39 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5297b106-bd9d-495f-92f4-93494e1fef80 Sep 28 17:28:39 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:39 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5297b106-bd9d-495f-92f4-93494e1fef80" returned: 0 in 0.307s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.945s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1914503050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295121d8-2db3-4b63-bfb0-9f3b06324ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f5bb6a23280467585aeb3b03a29b4de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:36Z,use_quota=True,user_id='933042ff6f50431fb36dd8ba51204e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Creating volume 295121d8-2db3-4b63-bfb0-9f3b06324ba8 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:39 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:39 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:28:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-295121d8-2db3-4b63-bfb0-9f3b06324ba8 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:39 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-295121d8-2db3-4b63-bfb0-9f3b06324ba8 1073741824 Sep 28 17:28:39 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:39 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf620e7-25c4-4e59-9a93-15ce5f294c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5297b106-bd9d-495f-92f4-93494e1fef80', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:39 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8ccaef-1ed9-4b1d-82d3-dc64a1964f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:39 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Volume volume-5297b106-bd9d-495f-92f4-93494e1fef80 (5297b106-bd9d-495f-92f4-93494e1fef80): created successfully Sep 28 17:28:39 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8ccaef-1ed9-4b1d-82d3-dc64a1964f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:39 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Flow 'volume_create_manager' (0f4d03a1-c279-4ae0-a618-a445d4b3bc32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:39 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-9c120abe-e88e-4d69-8b33-417e2e2f3ed0 tempest-CreateVolumesFromImageTest-338088606 None] Created volume successfully. Sep 28 17:28:40 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-295121d8-2db3-4b63-bfb0-9f3b06324ba8 1073741824" returned: 0 in 0.671s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-295121d8-2db3-4b63-bfb0-9f3b06324ba8 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:40 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-295121d8-2db3-4b63-bfb0-9f3b06324ba8 Sep 28 17:28:40 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Flow 'volume_create_manager' (f0b7aa60-70ed-4b1c-a8df-7e0f89f3590c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125096f5-7be0-4ec7-9a7d-e6f905cb0471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125096f5-7be0-4ec7-9a7d-e6f905cb0471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaac65fb7c15445ca4d92ef88b35d333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:40Z,use_quota=True,user_id='cd430f2045334b078b31361fb7cc4cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(356784b1-e163-447b-a9d4-98c5a6f3591b),volume_type_id=356784b1-e163-447b-a9d4-98c5a6f3591b)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eaf1fe4-b704-4b22-8c55-80c0dd7b1a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eaf1fe4-b704-4b22-8c55-80c0dd7b1a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dfc5a3e-1f98-4a83-8662-9434eaca4d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.image.glance [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Creating Keystone auth plugin from conf {{(pid=87061) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:28:40 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-295121d8-2db3-4b63-bfb0-9f3b06324ba8" returned: 0 in 0.284s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.644s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1004045653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f9e833-858f-446e-a7e6-e69ecd6dc9ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f5bb6a23280467585aeb3b03a29b4de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:37Z,use_quota=True,user_id='933042ff6f50431fb36dd8ba51204e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Creating volume 86f9e833-858f-446e-a7e6-e69ecd6dc9ae {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:40 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86f9e833-858f-446e-a7e6-e69ecd6dc9ae 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:40 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86f9e833-858f-446e-a7e6-e69ecd6dc9ae 1073741824 Sep 28 17:28:40 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245daa4c-f4ed-4fcb-8bbc-5426381bd7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-295121d8-2db3-4b63-bfb0-9f3b06324ba8', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c00a5f-c95e-48a3-9aca-39f5d776f399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:40 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Volume volume-295121d8-2db3-4b63-bfb0-9f3b06324ba8 (295121d8-2db3-4b63-bfb0-9f3b06324ba8): created successfully Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c00a5f-c95e-48a3-9aca-39f5d776f399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Flow 'volume_create_manager' (ffd201a4-9404-407e-ad3b-61377c9398d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:40 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-7b32199e-3e5b-49e2-a7cd-f28506349e9a tempest-CreateVolumesFromImageTest-338088606 None] Created volume successfully. Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dfc5a3e-1f98-4a83-8662-9434eaca4d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3', 'volume_name': 'volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3', 'volume_size': 1, 'image_id': 'c511dc73-8e33-479c-8a48-421de4744c65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c511dc73-8e33-479c-8a48-421de4744c65', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e29239ca10c3596b2141f96d0a791660', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eaac65fb7c15445ca4d92ef88b35d333', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '246a5b80d6cab353dde2f1c8866a00ffc067da8ee9e35b0edefe00b73929d3b531bbb5a2489837a27240d4692a87564b21169e0015f6a19b3fa02ddc4e1919c6', 'id': 'c511dc73-8e33-479c-8a48-421de4744c65', 'created_at': datetime.datetime(2026, 9, 28, 15, 28, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 28, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c511dc73-8e33-479c-8a48-421de4744c65/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a9fc6a4-b8bf-49c9-b1b9-f11f6f2efb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a9fc6a4-b8bf-49c9-b1b9-f11f6f2efb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf559d9-2dac-4024-9cd3-eb913db6dd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:40 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Volume 5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3', 'volume_size': 1, 'image_id': 'c511dc73-8e33-479c-8a48-421de4744c65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c511dc73-8e33-479c-8a48-421de4744c65', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e29239ca10c3596b2141f96d0a791660', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eaac65fb7c15445ca4d92ef88b35d333', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '246a5b80d6cab353dde2f1c8866a00ffc067da8ee9e35b0edefe00b73929d3b531bbb5a2489837a27240d4692a87564b21169e0015f6a19b3fa02ddc4e1919c6', 'id': 'c511dc73-8e33-479c-8a48-421de4744c65', 'created_at': datetime.datetime(2026, 9, 28, 15, 28, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 28, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c511dc73-8e33-479c-8a48-421de4744c65/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 17:28:40 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Trying to clone 5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3 from image c511dc73-8e33-479c-8a48-421de4744c65 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c511dc73-8e33-479c-8a48-421de4744c65', 'metadata': {}}]). {{(pid=87061) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:28:41 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[debef8ac-8c86-4125-97e0-1efb7c8be209]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:41 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86f9e833-858f-446e-a7e6-e69ecd6dc9ae 1073741824" returned: 0 in 0.598s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86f9e833-858f-446e-a7e6-e69ecd6dc9ae {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:41 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86f9e833-858f-446e-a7e6-e69ecd6dc9ae Sep 28 17:28:41 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:41 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD Sep 28 17:28:41 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:41 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86f9e833-858f-446e-a7e6-e69ecd6dc9ae" returned: 0 in 0.301s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-6d875ea2-6674-4406-8b34-24e218b48470 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.070s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:41 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d38cc4-e8f0-401a-a4c1-ab30f4eb690a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86f9e833-858f-446e-a7e6-e69ecd6dc9ae', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2516728b-9168-4207-9166-3d48b20795eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-6d875ea2-6674-4406-8b34-24e218b48470 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Creating offline snapshot b2483e09-4c8c-47e7-86d6-05d4c41eee50 of volume 5379e968-ad3c-4404-a6a9-c1a2a2312415 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:28:41 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Volume volume-86f9e833-858f-446e-a7e6-e69ecd6dc9ae (86f9e833-858f-446e-a7e6-e69ecd6dc9ae): created successfully Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2516728b-9168-4207-9166-3d48b20795eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Flow 'volume_create_manager' (befb96ae-0a7a-4308-8c23-e349a2f0c323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[c371a52c-ace0-4c0c-950d-e9c51c33a0c1]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6d875ea2-6674-4406-8b34-24e218b48470 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:41 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-08cbfa65-d346-44d4-98f8-0c44f3b5e546 tempest-CreateVolumesFromImageTest-338088606 None] Created volume successfully. Sep 28 17:28:41 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD Sep 28 17:28:41 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:41 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415 Sep 28 17:28:41 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Flow 'volume_create_manager' (8938822b-bdd2-42aa-8c1d-3afbc7ce68e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a91d4f5-06fa-42cd-90cc-6a2a61f4644d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a91d4f5-06fa-42cd-90cc-6a2a61f4644d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1084072910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6614ae58-ef5e-4540-96bf-b8289ad800ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716b289f0179458f8e2e869e7ff71485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:42Z,use_quota=True,user_id='ccaca5bfad8b4b96b2ae3b66012f813b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21989387-0b84-4d18-923e-02aed7fd6ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21989387-0b84-4d18-923e-02aed7fd6ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d7d38c-b90f-45f5-998c-e3e7f501cdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d7d38c-b90f-45f5-998c-e3e7f501cdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6614ae58-ef5e-4540-96bf-b8289ad800ff', 'volume_name': 'volume-6614ae58-ef5e-4540-96bf-b8289ad800ff', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ff0211-6aa1-4462-8373-57208481275a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ff0211-6aa1-4462-8373-57208481275a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4165c8e9-4fad-4ea7-b521-461847dc71d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:41 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Volume 6614ae58-ef5e-4540-96bf-b8289ad800ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6614ae58-ef5e-4540-96bf-b8289ad800ff', 'volume_size': 1} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:41 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD" returned: 1 in 0.396s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:28:41 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Temporary image c511dc73-8e33-479c-8a48-421de4744c65 is fetched for user cd430f2045334b078b31361fb7cc4cce. {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:28:42 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a643c04-a638-4b5c-8382-4e1e2138354a]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:42 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6d875ea2-6674-4406-8b34-24e218b48470 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415" returned: 0 in 0.474s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6d875ea2-6674-4406-8b34-24e218b48470 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.b2483e09-4c8c-47e7-86d6-05d4c41eee50 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:42 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.b2483e09-4c8c-47e7-86d6-05d4c41eee50 1G Sep 28 17:28:42 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:42 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD Sep 28 17:28:42 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2b3a3d9a-ca24-4758-9889-f5cf4d2c60d1 tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "cinder-86f9e833-858f-446e-a7e6-e69ecd6dc9ae-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2b3a3d9a-ca24-4758-9889-f5cf4d2c60d1 tempest-CreateVolumesFromImageTest-338088606 None] Lock "cinder-86f9e833-858f-446e-a7e6-e69ecd6dc9ae-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:42 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2b3a3d9a-ca24-4758-9889-f5cf4d2c60d1 tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "cinder-quobyte-86f9e833-858f-446e-a7e6-e69ecd6dc9ae" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2b3a3d9a-ca24-4758-9889-f5cf4d2c60d1 tempest-CreateVolumesFromImageTest-338088606 None] Lock "cinder-quobyte-86f9e833-858f-446e-a7e6-e69ecd6dc9ae" acquired by "delete_volume" :: waited 0.032s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:42 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[91442ab7-4448-4058-9550-8f702ef4ed13]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2b3a3d9a-ca24-4758-9889-f5cf4d2c60d1 tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86f9e833-858f-446e-a7e6-e69ecd6dc9ae {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:42 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD Sep 28 17:28:42 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:42 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86f9e833-858f-446e-a7e6-e69ecd6dc9ae Sep 28 17:28:42 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:42 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6d875ea2-6674-4406-8b34-24e218b48470 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.b2483e09-4c8c-47e7-86d6-05d4c41eee50 1G" returned: 0 in 0.616s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6d875ea2-6674-4406-8b34-24e218b48470 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5379e968-ad3c-4404-a6a9-c1a2a2312415 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.b2483e09-4c8c-47e7-86d6-05d4c41eee50 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:42 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5379e968-ad3c-4404-a6a9-c1a2a2312415 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.b2483e09-4c8c-47e7-86d6-05d4c41eee50 Sep 28 17:28:42 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:42 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD" returned: 1 in 0.390s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:28:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:42 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2b3a3d9a-ca24-4758-9889-f5cf4d2c60d1 tempest-CreateVolumesFromImageTest-338088606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86f9e833-858f-446e-a7e6-e69ecd6dc9ae" returned: 0 in 0.477s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2b3a3d9a-ca24-4758-9889-f5cf4d2c60d1 tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86f9e833-858f-446e-a7e6-e69ecd6dc9ae {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:42 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86f9e833-858f-446e-a7e6-e69ecd6dc9ae Sep 28 17:28:42 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:43 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6d875ea2-6674-4406-8b34-24e218b48470 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5379e968-ad3c-4404-a6a9-c1a2a2312415 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.b2483e09-4c8c-47e7-86d6-05d4c41eee50" returned: 0 in 0.361s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:43 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-6d875ea2-6674-4406-8b34-24e218b48470 tempest-CreateVolumesFromSnapshotTest-1297301981 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.b2483e09-4c8c-47e7-86d6-05d4c41eee50 is being set with open permissions: ugo+rw Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6d875ea2-6674-4406-8b34-24e218b48470 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.b2483e09-4c8c-47e7-86d6-05d4c41eee50 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:43 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.b2483e09-4c8c-47e7-86d6-05d4c41eee50 Sep 28 17:28:43 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:43 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2b3a3d9a-ca24-4758-9889-f5cf4d2c60d1 tempest-CreateVolumesFromImageTest-338088606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-86f9e833-858f-446e-a7e6-e69ecd6dc9ae" returned: 0 in 0.312s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2b3a3d9a-ca24-4758-9889-f5cf4d2c60d1 tempest-CreateVolumesFromImageTest-338088606 None] Lock "cinder-quobyte-86f9e833-858f-446e-a7e6-e69ecd6dc9ae" released by "delete_volume" :: held 0.840s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:43 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6d875ea2-6674-4406-8b34-24e218b48470 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.b2483e09-4c8c-47e7-86d6-05d4c41eee50" returned: 0 in 0.313s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-2b3a3d9a-ca24-4758-9889-f5cf4d2c60d1 tempest-CreateVolumesFromImageTest-338088606 None] Created reservations ['8a066981-bac7-4806-9ff0-baf79b1a5998', '142f06a2-1ef1-4ab5-8ecf-272a66510fce', 'be091f67-880d-4e99-971c-db67efccf536', '970b79b8-39f7-495f-a9a6-a728111af28d'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6d875ea2-6674-4406-8b34-24e218b48470 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:43 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.info Sep 28 17:28:43 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2b3a3d9a-ca24-4758-9889-f5cf4d2c60d1 tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2b3a3d9a-ca24-4758-9889-f5cf4d2c60d1 tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2b3a3d9a-ca24-4758-9889-f5cf4d2c60d1 tempest-CreateVolumesFromImageTest-338088606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2b3a3d9a-ca24-4758-9889-f5cf4d2c60d1 tempest-CreateVolumesFromImageTest-338088606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2b3a3d9a-ca24-4758-9889-f5cf4d2c60d1 tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2b3a3d9a-ca24-4758-9889-f5cf4d2c60d1 tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:43 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:28:43 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-14ccc1e6-2cfe-4750-af4d-ea49ebeefb17 tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "cinder-295121d8-2db3-4b63-bfb0-9f3b06324ba8-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-14ccc1e6-2cfe-4750-af4d-ea49ebeefb17 tempest-CreateVolumesFromImageTest-338088606 None] Lock "cinder-295121d8-2db3-4b63-bfb0-9f3b06324ba8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-14ccc1e6-2cfe-4750-af4d-ea49ebeefb17 tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "cinder-quobyte-295121d8-2db3-4b63-bfb0-9f3b06324ba8" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-14ccc1e6-2cfe-4750-af4d-ea49ebeefb17 tempest-CreateVolumesFromImageTest-338088606 None] Lock "cinder-quobyte-295121d8-2db3-4b63-bfb0-9f3b06324ba8" acquired by "delete_volume" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:43 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6d875ea2-6674-4406-8b34-24e218b48470 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.info" returned: 0 in 0.339s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:43 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-6d875ea2-6674-4406-8b34-24e218b48470 tempest-CreateVolumesFromSnapshotTest-1297301981 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.info is being set with open permissions: ugo+rw Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6d875ea2-6674-4406-8b34-24e218b48470 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[af12c7c3-7482-4de0-ac32-57daad4aa18f]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-14ccc1e6-2cfe-4750-af4d-ea49ebeefb17 tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-295121d8-2db3-4b63-bfb0-9f3b06324ba8 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:43 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.info Sep 28 17:28:43 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:43 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2b3a3d9a-ca24-4758-9889-f5cf4d2c60d1 tempest-CreateVolumesFromImageTest-338088606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.348s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-2b3a3d9a-ca24-4758-9889-f5cf4d2c60d1 tempest-CreateVolumesFromImageTest-338088606 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:43 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-2b3a3d9a-ca24-4758-9889-f5cf4d2c60d1 tempest-CreateVolumesFromImageTest-338088606 None] Deleted volume successfully. Sep 28 17:28:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2b3a3d9a-ca24-4758-9889-f5cf4d2c60d1 tempest-CreateVolumesFromImageTest-338088606 None] Lock "cinder-86f9e833-858f-446e-a7e6-e69ecd6dc9ae-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:43 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-295121d8-2db3-4b63-bfb0-9f3b06324ba8 Sep 28 17:28:43 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:44 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6d875ea2-6674-4406-8b34-24e218b48470 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.info" returned: 0 in 0.286s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-6d875ea2-6674-4406-8b34-24e218b48470 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.566s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.198s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1084072910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6614ae58-ef5e-4540-96bf-b8289ad800ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716b289f0179458f8e2e869e7ff71485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:42Z,use_quota=True,user_id='ccaca5bfad8b4b96b2ae3b66012f813b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Creating volume 6614ae58-ef5e-4540-96bf-b8289ad800ff {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:44 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:44 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff 1073741824 Sep 28 17:28:44 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:44 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-6d875ea2-6674-4406-8b34-24e218b48470 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Create snapshot completed successfully Sep 28 17:28:44 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-14ccc1e6-2cfe-4750-af4d-ea49ebeefb17 tempest-CreateVolumesFromImageTest-338088606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-295121d8-2db3-4b63-bfb0-9f3b06324ba8" returned: 0 in 0.425s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-14ccc1e6-2cfe-4750-af4d-ea49ebeefb17 tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-295121d8-2db3-4b63-bfb0-9f3b06324ba8 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:44 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-295121d8-2db3-4b63-bfb0-9f3b06324ba8 Sep 28 17:28:44 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:44 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-14ccc1e6-2cfe-4750-af4d-ea49ebeefb17 tempest-CreateVolumesFromImageTest-338088606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-295121d8-2db3-4b63-bfb0-9f3b06324ba8" returned: 0 in 0.279s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-14ccc1e6-2cfe-4750-af4d-ea49ebeefb17 tempest-CreateVolumesFromImageTest-338088606 None] Lock "cinder-quobyte-295121d8-2db3-4b63-bfb0-9f3b06324ba8" released by "delete_volume" :: held 0.773s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-14ccc1e6-2cfe-4750-af4d-ea49ebeefb17 tempest-CreateVolumesFromImageTest-338088606 None] Created reservations ['961d4a8a-d0ef-4f81-b8ff-dc912bb61e9a', 'ce70498e-30e8-4403-b660-099c3da4dc54', 'cf018438-fad0-435d-b64a-e62c6ddcfdf5', 'fd98db3b-f3a3-4fb7-8817-e6b2922967b7'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:44 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff 1073741824" returned: 0 in 0.505s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-14ccc1e6-2cfe-4750-af4d-ea49ebeefb17 tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-14ccc1e6-2cfe-4750-af4d-ea49ebeefb17 tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-14ccc1e6-2cfe-4750-af4d-ea49ebeefb17 tempest-CreateVolumesFromImageTest-338088606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-14ccc1e6-2cfe-4750-af4d-ea49ebeefb17 tempest-CreateVolumesFromImageTest-338088606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-14ccc1e6-2cfe-4750-af4d-ea49ebeefb17 tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-14ccc1e6-2cfe-4750-af4d-ea49ebeefb17 tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:44 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff Sep 28 17:28:44 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:44 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:28:44 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8cb2910d-7cb8-4715-b709-76c00ec92790 tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "cinder-5297b106-bd9d-495f-92f4-93494e1fef80-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8cb2910d-7cb8-4715-b709-76c00ec92790 tempest-CreateVolumesFromImageTest-338088606 None] Lock "cinder-5297b106-bd9d-495f-92f4-93494e1fef80-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8cb2910d-7cb8-4715-b709-76c00ec92790 tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "cinder-quobyte-5297b106-bd9d-495f-92f4-93494e1fef80" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8cb2910d-7cb8-4715-b709-76c00ec92790 tempest-CreateVolumesFromImageTest-338088606 None] Lock "cinder-quobyte-5297b106-bd9d-495f-92f4-93494e1fef80" acquired by "delete_volume" :: waited 0.035s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[88295b00-eaff-4ff0-ae51-8f8289e04790]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8cb2910d-7cb8-4715-b709-76c00ec92790 tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5297b106-bd9d-495f-92f4-93494e1fef80 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:45 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff" returned: 0 in 0.425s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.236s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaac65fb7c15445ca4d92ef88b35d333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:40Z,use_quota=True,user_id='cd430f2045334b078b31361fb7cc4cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(356784b1-e163-447b-a9d4-98c5a6f3591b),volume_type_id=356784b1-e163-447b-a9d4-98c5a6f3591b)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Creating volume 5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:45 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:45 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:45 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3 1073741824 Sep 28 17:28:45 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4165c8e9-4fad-4ea7-b521-461847dc71d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6614ae58-ef5e-4540-96bf-b8289ad800ff', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:45 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5297b106-bd9d-495f-92f4-93494e1fef80 Sep 28 17:28:45 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4448803c-59a4-4fa7-9163-bd4328eeafe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-14ccc1e6-2cfe-4750-af4d-ea49ebeefb17 tempest-CreateVolumesFromImageTest-338088606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.521s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-14ccc1e6-2cfe-4750-af4d-ea49ebeefb17 tempest-CreateVolumesFromImageTest-338088606 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:45 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-14ccc1e6-2cfe-4750-af4d-ea49ebeefb17 tempest-CreateVolumesFromImageTest-338088606 None] Deleted volume successfully. Sep 28 17:28:45 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Volume volume-6614ae58-ef5e-4540-96bf-b8289ad800ff (6614ae58-ef5e-4540-96bf-b8289ad800ff): created successfully Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4448803c-59a4-4fa7-9163-bd4328eeafe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Flow 'volume_create_manager' (8938822b-bdd2-42aa-8c1d-3afbc7ce68e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-14ccc1e6-2cfe-4750-af4d-ea49ebeefb17 tempest-CreateVolumesFromImageTest-338088606 None] Lock "cinder-295121d8-2db3-4b63-bfb0-9f3b06324ba8-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:45 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-b8475cfd-dc7d-4a01-af37-6d6072c769b5 tempest-ProjectMemberTests-584998297 None] Created volume successfully. Sep 28 17:28:45 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8cb2910d-7cb8-4715-b709-76c00ec92790 tempest-CreateVolumesFromImageTest-338088606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5297b106-bd9d-495f-92f4-93494e1fef80" returned: 0 in 0.550s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8cb2910d-7cb8-4715-b709-76c00ec92790 tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5297b106-bd9d-495f-92f4-93494e1fef80 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:45 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5297b106-bd9d-495f-92f4-93494e1fef80 Sep 28 17:28:45 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Flow 'volume_create_manager' (30881c22-2323-4687-92dc-fc646945bb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54cd2447-e50c-4c07-8ca2-6ca8a8fea819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54cd2447-e50c-4c07-8ca2-6ca8a8fea819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-24550775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb9925c-0a22-41ea-9f8d-8380484ce294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d8463010cb4ad996ec1e17140bfa08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:46Z,use_quota=True,user_id='0b560e96d117438289613d5f807e131a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1aa2a9-fc86-4ee5-8a37-eee8bd6a9f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1aa2a9-fc86-4ee5-8a37-eee8bd6a9f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfeaedde-ae29-4977-bb62-db19c08ffd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfeaedde-ae29-4977-bb62-db19c08ffd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbb9925c-0a22-41ea-9f8d-8380484ce294', 'volume_name': 'volume-cbb9925c-0a22-41ea-9f8d-8380484ce294', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68802106-ba57-4f42-bd62-58e3a1b56b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68802106-ba57-4f42-bd62-58e3a1b56b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd78eebf-7b25-47ec-ab85-973308774ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:45 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Volume cbb9925c-0a22-41ea-9f8d-8380484ce294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbb9925c-0a22-41ea-9f8d-8380484ce294', 'volume_size': 1} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:45 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3 1073741824" returned: 0 in 0.728s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:45 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3 Sep 28 17:28:45 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:45 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8cb2910d-7cb8-4715-b709-76c00ec92790 tempest-CreateVolumesFromImageTest-338088606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5297b106-bd9d-495f-92f4-93494e1fef80" returned: 0 in 0.349s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:45 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8cb2910d-7cb8-4715-b709-76c00ec92790 tempest-CreateVolumesFromImageTest-338088606 None] Lock "cinder-quobyte-5297b106-bd9d-495f-92f4-93494e1fef80" released by "delete_volume" :: held 0.995s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Flow 'volume_create_manager' (b4bd1d4d-9152-44a3-a3e1-f03eb3d290ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19771ee4-e83d-4018-af6d-239b2c5b0dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19771ee4-e83d-4018-af6d-239b2c5b0dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1895563876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98e1c21-4c63-4989-bbb8-23f98f8d4dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d8463010cb4ad996ec1e17140bfa08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:46Z,use_quota=True,user_id='0b560e96d117438289613d5f807e131a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c77b4e-ea91-4c63-a970-71385a1680f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c77b4e-ea91-4c63-a970-71385a1680f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05887323-50ff-4398-929a-0f977898ddb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05887323-50ff-4398-929a-0f977898ddb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e98e1c21-4c63-4989-bbb8-23f98f8d4dab', 'volume_name': 'volume-e98e1c21-4c63-4989-bbb8-23f98f8d4dab', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9a7899-bda4-4939-8cf8-10559dfc814f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9a7899-bda4-4939-8cf8-10559dfc814f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b518c0a-7474-4d19-832b-fa798f1a4158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:46 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Volume e98e1c21-4c63-4989-bbb8-23f98f8d4dab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e98e1c21-4c63-4989-bbb8-23f98f8d4dab', 'volume_size': 1} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:46 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-8cb2910d-7cb8-4715-b709-76c00ec92790 tempest-CreateVolumesFromImageTest-338088606 None] Created reservations ['d2145f37-f791-4489-b7b7-4fce0cbd54ce', 'f8c42090-c7f4-4410-a32c-f57245025e3b', '067d014d-ecc0-4050-b615-6bac01fa42d9', '98e99e9d-ee24-4acd-9406-869b20c6c6b6'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3" returned: 0 in 0.349s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.452s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-24550775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb9925c-0a22-41ea-9f8d-8380484ce294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d8463010cb4ad996ec1e17140bfa08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:46Z,use_quota=True,user_id='0b560e96d117438289613d5f807e131a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Creating volume cbb9925c-0a22-41ea-9f8d-8380484ce294 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:46 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cbb9925c-0a22-41ea-9f8d-8380484ce294 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:46 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cbb9925c-0a22-41ea-9f8d-8380484ce294 1073741824 Sep 28 17:28:46 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Attempting download of c511dc73-8e33-479c-8a48-421de4744c65 ((None, [{'url': 'file:///opt/stack/data/glance/images/c511dc73-8e33-479c-8a48-421de4744c65', 'metadata': {}}])) to volume 5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3. {{(pid=87061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8cb2910d-7cb8-4715-b709-76c00ec92790 tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8cb2910d-7cb8-4715-b709-76c00ec92790 tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8cb2910d-7cb8-4715-b709-76c00ec92790 tempest-CreateVolumesFromImageTest-338088606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8cb2910d-7cb8-4715-b709-76c00ec92790 tempest-CreateVolumesFromImageTest-338088606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8cb2910d-7cb8-4715-b709-76c00ec92790 tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8cb2910d-7cb8-4715-b709-76c00ec92790 tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:46 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:28:46 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f7bf2e-b77a-4279-a992-23da3944904f]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c511dc73-8e33-479c-8a48-421de4744c65_f4kymru1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Flow 'volume_create_manager' (4ea88822-f706-4689-9c94-f15418920006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53009834-4f4c-4608-bf29-f45a99dee7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:46 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c511dc73-8e33-479c-8a48-421de4744c65_f4kymru1 Sep 28 17:28:46 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53009834-4f4c-4608-bf29-f45a99dee7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1682137510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b03e88d-72d6-48c8-b06e-c0878dec81af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d8463010cb4ad996ec1e17140bfa08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:46Z,use_quota=True,user_id='0b560e96d117438289613d5f807e131a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426746bf-32af-4c26-a1cd-7998182896bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426746bf-32af-4c26-a1cd-7998182896bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd1c762-1f5b-47d7-aafa-a75fdfbcb326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd1c762-1f5b-47d7-aafa-a75fdfbcb326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b03e88d-72d6-48c8-b06e-c0878dec81af', 'volume_name': 'volume-2b03e88d-72d6-48c8-b06e-c0878dec81af', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068e577d-126b-4fdf-93bf-e0d4418e9239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068e577d-126b-4fdf-93bf-e0d4418e9239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b0c780-fe68-47c1-ba10-f546bea9ea44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:46 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Volume 2b03e88d-72d6-48c8-b06e-c0878dec81af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b03e88d-72d6-48c8-b06e-c0878dec81af', 'volume_size': 1} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:46 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:46 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c511dc73-8e33-479c-8a48-421de4744c65_f4kymru1" returned: 0 in 0.536s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c511dc73-8e33-479c-8a48-421de4744c65_f4kymru1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8cb2910d-7cb8-4715-b709-76c00ec92790 tempest-CreateVolumesFromImageTest-338088606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.628s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-8cb2910d-7cb8-4715-b709-76c00ec92790 tempest-CreateVolumesFromImageTest-338088606 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:47 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-8cb2910d-7cb8-4715-b709-76c00ec92790 tempest-CreateVolumesFromImageTest-338088606 None] Deleted volume successfully. Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c9e791f8-d708-48a5-a38c-ad5a0e3ddc6e tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8cb2910d-7cb8-4715-b709-76c00ec92790 tempest-CreateVolumesFromImageTest-338088606 None] Lock "cinder-5297b106-bd9d-495f-92f4-93494e1fef80-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:47 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cbb9925c-0a22-41ea-9f8d-8380484ce294 1073741824" returned: 0 in 0.954s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:47 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c511dc73-8e33-479c-8a48-421de4744c65_f4kymru1 Sep 28 17:28:47 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cbb9925c-0a22-41ea-9f8d-8380484ce294 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2eaa45ea-3027-4895-833d-b7f4d68f3b0b tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "cinder-fe6a8175-6279-4f09-881b-02a667802dfd-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:47 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cbb9925c-0a22-41ea-9f8d-8380484ce294 Sep 28 17:28:47 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Flow 'volume_create_manager' (69bfb453-7919-41cd-a251-1d56fc346ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619d0cfa-869e-4b71-8fcc-a7be9b872509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2eaa45ea-3027-4895-833d-b7f4d68f3b0b tempest-CreateVolumesFromImageTest-338088606 None] Lock "cinder-fe6a8175-6279-4f09-881b-02a667802dfd-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619d0cfa-869e-4b71-8fcc-a7be9b872509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-329136476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061017b7-3cb0-435a-a7ef-67c6774cc6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d8463010cb4ad996ec1e17140bfa08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:47Z,use_quota=True,user_id='0b560e96d117438289613d5f807e131a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3579c898-8317-4992-974e-e19ce0f9389c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3579c898-8317-4992-974e-e19ce0f9389c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df24095-5228-4b0b-b19c-254150f03506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df24095-5228-4b0b-b19c-254150f03506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '061017b7-3cb0-435a-a7ef-67c6774cc6ea', 'volume_name': 'volume-061017b7-3cb0-435a-a7ef-67c6774cc6ea', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9d6b19-d9d3-43eb-a14d-9595538fe3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9d6b19-d9d3-43eb-a14d-9595538fe3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb3a38e-422c-42df-969c-d2e2d734a09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:47 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Volume 061017b7-3cb0-435a-a7ef-67c6774cc6ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-061017b7-3cb0-435a-a7ef-67c6774cc6ea', 'volume_size': 1} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:47 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c511dc73-8e33-479c-8a48-421de4744c65_f4kymru1" returned: 1 in 0.512s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c511dc73-8e33-479c-8a48-421de4744c65_f4kymru1' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[016a8f78-ffc6-4e4f-9f4c-c93499d2604c]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2eaa45ea-3027-4895-833d-b7f4d68f3b0b tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "cinder-quobyte-fe6a8175-6279-4f09-881b-02a667802dfd" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:47 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cbb9925c-0a22-41ea-9f8d-8380484ce294" returned: 0 in 0.337s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2eaa45ea-3027-4895-833d-b7f4d68f3b0b tempest-CreateVolumesFromImageTest-338088606 None] Lock "cinder-quobyte-fe6a8175-6279-4f09-881b-02a667802dfd" acquired by "delete_volume" :: waited 0.042s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.472s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1895563876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98e1c21-4c63-4989-bbb8-23f98f8d4dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d8463010cb4ad996ec1e17140bfa08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:46Z,use_quota=True,user_id='0b560e96d117438289613d5f807e131a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Creating volume e98e1c21-4c63-4989-bbb8-23f98f8d4dab {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:47 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e98e1c21-4c63-4989-bbb8-23f98f8d4dab 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a845c1a-c38c-44ec-b750-f552ad6476bf]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2eaa45ea-3027-4895-833d-b7f4d68f3b0b tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fe6a8175-6279-4f09-881b-02a667802dfd {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:47 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e98e1c21-4c63-4989-bbb8-23f98f8d4dab 1073741824 Sep 28 17:28:47 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:47 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD Sep 28 17:28:47 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd78eebf-7b25-47ec-ab85-973308774ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbb9925c-0a22-41ea-9f8d-8380484ce294', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ddccb06-bfbc-45ff-8e67-c4eec5f22590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:47 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Volume volume-cbb9925c-0a22-41ea-9f8d-8380484ce294 (cbb9925c-0a22-41ea-9f8d-8380484ce294): created successfully Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ddccb06-bfbc-45ff-8e67-c4eec5f22590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Flow 'volume_create_manager' (30881c22-2323-4687-92dc-fc646945bb26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:47 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-07e773d6-e844-4851-b5dd-ac8748ec6525 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Created volume successfully. Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:47 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fe6a8175-6279-4f09-881b-02a667802dfd Sep 28 17:28:47 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Flow 'volume_create_manager' (15f7a4bc-d08b-4b60-bd8f-1c9e1624fa69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b23568-0877-4cbe-a56c-a3b39d92e381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b23568-0877-4cbe-a56c-a3b39d92e381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-701464563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c21bb42f-0b35-457f-b203-c30b23e22ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d8463010cb4ad996ec1e17140bfa08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:48Z,use_quota=True,user_id='0b560e96d117438289613d5f807e131a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010b8745-7380-4f8f-8dd2-989a3765aad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010b8745-7380-4f8f-8dd2-989a3765aad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa40472c-22eb-432b-af11-2ea0bc9eb06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa40472c-22eb-432b-af11-2ea0bc9eb06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c21bb42f-0b35-457f-b203-c30b23e22ed0', 'volume_name': 'volume-c21bb42f-0b35-457f-b203-c30b23e22ed0', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbfa7b39-66f0-4210-ab52-35158cd05de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbfa7b39-66f0-4210-ab52-35158cd05de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5801ab0-6b96-4e7d-92ce-3aadbaeed06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:47 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Volume c21bb42f-0b35-457f-b203-c30b23e22ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c21bb42f-0b35-457f-b203-c30b23e22ed0', 'volume_size': 1} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:47 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD" returned: 0 in 0.482s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:48 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD Sep 28 17:28:48 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:48 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2eaa45ea-3027-4895-833d-b7f4d68f3b0b tempest-CreateVolumesFromImageTest-338088606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fe6a8175-6279-4f09-881b-02a667802dfd" returned: 0 in 0.515s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2eaa45ea-3027-4895-833d-b7f4d68f3b0b tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fe6a8175-6279-4f09-881b-02a667802dfd {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:48 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fe6a8175-6279-4f09-881b-02a667802dfd Sep 28 17:28:48 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:48 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e98e1c21-4c63-4989-bbb8-23f98f8d4dab 1073741824" returned: 0 in 0.576s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e98e1c21-4c63-4989-bbb8-23f98f8d4dab {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:48 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e98e1c21-4c63-4989-bbb8-23f98f8d4dab Sep 28 17:28:48 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:48 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD" returned: 1 in 0.395s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] c511dc73-8e33-479c-8a48-421de4744c65 was raw, converting to qcow2 {{(pid=87061) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:48 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3 Sep 28 17:28:48 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:48 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2eaa45ea-3027-4895-833d-b7f4d68f3b0b tempest-CreateVolumesFromImageTest-338088606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-fe6a8175-6279-4f09-881b-02a667802dfd" returned: 0 in 0.306s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2eaa45ea-3027-4895-833d-b7f4d68f3b0b tempest-CreateVolumesFromImageTest-338088606 None] Lock "cinder-quobyte-fe6a8175-6279-4f09-881b-02a667802dfd" released by "delete_volume" :: held 0.900s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:48 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e98e1c21-4c63-4989-bbb8-23f98f8d4dab" returned: 0 in 0.294s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.775s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1682137510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b03e88d-72d6-48c8-b06e-c0878dec81af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d8463010cb4ad996ec1e17140bfa08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:46Z,use_quota=True,user_id='0b560e96d117438289613d5f807e131a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Creating volume 2b03e88d-72d6-48c8-b06e-c0878dec81af {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:48 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2b03e88d-72d6-48c8-b06e-c0878dec81af 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-2eaa45ea-3027-4895-833d-b7f4d68f3b0b tempest-CreateVolumesFromImageTest-338088606 None] Created reservations ['dd68c8e7-e87e-483d-bfff-057e864b2284', 'cc6c9b2c-d22b-4bdc-a6cf-7b1b502a4b5a', 'c43ad2f5-033d-48db-b244-a507f54d37b9', 'aea9d683-496f-4a91-9756-e5d82e5f3822'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:48 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2b03e88d-72d6-48c8-b06e-c0878dec81af 1073741824 Sep 28 17:28:48 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b518c0a-7474-4d19-832b-fa798f1a4158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e98e1c21-4c63-4989-bbb8-23f98f8d4dab', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff5f4f1-3db6-49be-aa56-b187127d6d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:48 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Volume volume-e98e1c21-4c63-4989-bbb8-23f98f8d4dab (e98e1c21-4c63-4989-bbb8-23f98f8d4dab): created successfully Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff5f4f1-3db6-49be-aa56-b187127d6d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Flow 'volume_create_manager' (b4bd1d4d-9152-44a3-a3e1-f03eb3d290ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:48 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-013f6ff3-b0e6-418c-afa3-f61cf89de485 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Created volume successfully. Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2eaa45ea-3027-4895-833d-b7f4d68f3b0b tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2eaa45ea-3027-4895-833d-b7f4d68f3b0b tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2eaa45ea-3027-4895-833d-b7f4d68f3b0b tempest-CreateVolumesFromImageTest-338088606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2eaa45ea-3027-4895-833d-b7f4d68f3b0b tempest-CreateVolumesFromImageTest-338088606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2eaa45ea-3027-4895-833d-b7f4d68f3b0b tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2eaa45ea-3027-4895-833d-b7f4d68f3b0b tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:48 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:28:48 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:48 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3" returned: 0 in 0.605s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c511dc73-8e33-479c-8a48-421de4744c65_w27mkyqsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3 {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:28:48 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:28:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:49 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3 1G Sep 28 17:28:49 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:49 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2eaa45ea-3027-4895-833d-b7f4d68f3b0b tempest-CreateVolumesFromImageTest-338088606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.342s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-2eaa45ea-3027-4895-833d-b7f4d68f3b0b tempest-CreateVolumesFromImageTest-338088606 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:49 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-2eaa45ea-3027-4895-833d-b7f4d68f3b0b tempest-CreateVolumesFromImageTest-338088606 None] Deleted volume successfully. Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2eaa45ea-3027-4895-833d-b7f4d68f3b0b tempest-CreateVolumesFromImageTest-338088606 None] Lock "cinder-fe6a8175-6279-4f09-881b-02a667802dfd-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:49 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2b03e88d-72d6-48c8-b06e-c0878dec81af 1073741824" returned: 0 in 0.597s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2b03e88d-72d6-48c8-b06e-c0878dec81af {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:49 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2b03e88d-72d6-48c8-b06e-c0878dec81af Sep 28 17:28:49 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:49 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3 1G" returned: 0 in 0.376s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Downloaded image c511dc73-8e33-479c-8a48-421de4744c65 ((None, [{'url': 'file:///opt/stack/data/glance/images/c511dc73-8e33-479c-8a48-421de4744c65', 'metadata': {}}])) to volume 5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3 successfully. {{(pid=87061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Temporary image c511dc73-8e33-479c-8a48-421de4744c65 for user cd430f2045334b078b31361fb7cc4cce is deleted. {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Marking volume 5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3 as bootable. {{(pid=87061) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Copying metadata from image c511dc73-8e33-479c-8a48-421de4744c65 to 5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3. {{(pid=87061) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Creating volume glance metadata for volume 5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3 backed by image c511dc73-8e33-479c-8a48-421de4744c65 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c511dc73-8e33-479c-8a48-421de4744c65', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e29239ca10c3596b2141f96d0a791660', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87061) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf559d9-2dac-4024-9cd3-eb913db6dd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3', 'volume_size': 1, 'image_id': 'c511dc73-8e33-479c-8a48-421de4744c65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c511dc73-8e33-479c-8a48-421de4744c65', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e29239ca10c3596b2141f96d0a791660', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eaac65fb7c15445ca4d92ef88b35d333', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '246a5b80d6cab353dde2f1c8866a00ffc067da8ee9e35b0edefe00b73929d3b531bbb5a2489837a27240d4692a87564b21169e0015f6a19b3fa02ddc4e1919c6', 'id': 'c511dc73-8e33-479c-8a48-421de4744c65', 'created_at': datetime.datetime(2026, 9, 28, 15, 28, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 28, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c511dc73-8e33-479c-8a48-421de4744c65/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8578468-cd1d-4b17-aa13-ba6eee331f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:49 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2b03e88d-72d6-48c8-b06e-c0878dec81af" returned: 0 in 0.311s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c9e791f8-d708-48a5-a38c-ad5a0e3ddc6e tempest-ProjectMemberTests-584998297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.458s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:49 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Volume volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3 (5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3): created successfully Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8578468-cd1d-4b17-aa13-ba6eee331f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Flow 'volume_create_manager' (f0b7aa60-70ed-4b1c-a8df-7e0f89f3590c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bea6419a-6636-4b5b-9959-36c257b64697 tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "cinder-245e47ab-5cd0-46a0-9031-7c8f8206d102-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-c9e791f8-d708-48a5-a38c-ad5a0e3ddc6e tempest-ProjectMemberTests-584998297 None] Creating offline snapshot de1579bb-d476-4d65-8af0-b4270ecc8a9b of volume 6614ae58-ef5e-4540-96bf-b8289ad800ff {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b0c780-fe68-47c1-ba10-f546bea9ea44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b03e88d-72d6-48c8-b06e-c0878dec81af', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9afa78f-522e-41ee-be1b-2f8d2fc66792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:49 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-aa5fd4df-406a-42f3-b9dc-58ca6280a376 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Created volume successfully. Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73be186-bede-4388-9575-12ffca3595a6]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c9e791f8-d708-48a5-a38c-ad5a0e3ddc6e tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bea6419a-6636-4b5b-9959-36c257b64697 tempest-CreateVolumesFromImageTest-338088606 None] Lock "cinder-245e47ab-5cd0-46a0-9031-7c8f8206d102-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:49 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Volume volume-2b03e88d-72d6-48c8-b06e-c0878dec81af (2b03e88d-72d6-48c8-b06e-c0878dec81af): created successfully Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9afa78f-522e-41ee-be1b-2f8d2fc66792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Flow 'volume_create_manager' (4ea88822-f706-4689-9c94-f15418920006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:49 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-90a5d49b-64c7-4e8f-80ac-cdfacc4777de tempest-CreateVolumesFromSnapshotTest-1297301981 None] Created volume successfully. Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bea6419a-6636-4b5b-9959-36c257b64697 tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "cinder-quobyte-245e47ab-5cd0-46a0-9031-7c8f8206d102" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bea6419a-6636-4b5b-9959-36c257b64697 tempest-CreateVolumesFromImageTest-338088606 None] Lock "cinder-quobyte-245e47ab-5cd0-46a0-9031-7c8f8206d102" acquired by "delete_volume" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:49 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff Sep 28 17:28:49 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[419715b7-7773-40fb-b731-edf536d72ced]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bea6419a-6636-4b5b-9959-36c257b64697 tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-245e47ab-5cd0-46a0-9031-7c8f8206d102 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:49 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-245e47ab-5cd0-46a0-9031-7c8f8206d102 Sep 28 17:28:49 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:50 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c9e791f8-d708-48a5-a38c-ad5a0e3ddc6e tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff" returned: 0 in 0.473s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c9e791f8-d708-48a5-a38c-ad5a0e3ddc6e tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.de1579bb-d476-4d65-8af0-b4270ecc8a9b 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:50 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.de1579bb-d476-4d65-8af0-b4270ecc8a9b 1G Sep 28 17:28:50 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:50 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bea6419a-6636-4b5b-9959-36c257b64697 tempest-CreateVolumesFromImageTest-338088606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-245e47ab-5cd0-46a0-9031-7c8f8206d102" returned: 0 in 0.441s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bea6419a-6636-4b5b-9959-36c257b64697 tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-245e47ab-5cd0-46a0-9031-7c8f8206d102 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-b8250cad-33fc-4bf0-bfea-fa81be4eb584 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Acquiring lock "cinder-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:50 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-245e47ab-5cd0-46a0-9031-7c8f8206d102 Sep 28 17:28:50 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-b8250cad-33fc-4bf0-bfea-fa81be4eb584 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Lock "cinder-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-b8250cad-33fc-4bf0-bfea-fa81be4eb584 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Acquiring lock "cinder-quobyte-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-b8250cad-33fc-4bf0-bfea-fa81be4eb584 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Lock "cinder-quobyte-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3" acquired by "delete_volume" :: waited 0.026s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eccbb45-2840-408b-8d20-9fcf4c943ccf]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b8250cad-33fc-4bf0-bfea-fa81be4eb584 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:50 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3 Sep 28 17:28:50 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:50 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bea6419a-6636-4b5b-9959-36c257b64697 tempest-CreateVolumesFromImageTest-338088606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-245e47ab-5cd0-46a0-9031-7c8f8206d102" returned: 0 in 0.309s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bea6419a-6636-4b5b-9959-36c257b64697 tempest-CreateVolumesFromImageTest-338088606 None] Lock "cinder-quobyte-245e47ab-5cd0-46a0-9031-7c8f8206d102" released by "delete_volume" :: held 0.807s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-bea6419a-6636-4b5b-9959-36c257b64697 tempest-CreateVolumesFromImageTest-338088606 None] Created reservations ['1ae5610d-b7b1-4a04-bd9d-b7f39f859c31', 'ea763006-4732-4112-a78e-04096934f061', '13a2c549-5311-40ef-bfe6-a0b6e5bd972e', '33f966f6-86ef-4642-a9fd-e69c898906fa'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:50 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c9e791f8-d708-48a5-a38c-ad5a0e3ddc6e tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.de1579bb-d476-4d65-8af0-b4270ecc8a9b 1G" returned: 0 in 0.517s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c9e791f8-d708-48a5-a38c-ad5a0e3ddc6e tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6614ae58-ef5e-4540-96bf-b8289ad800ff -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.de1579bb-d476-4d65-8af0-b4270ecc8a9b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:50 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6614ae58-ef5e-4540-96bf-b8289ad800ff -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.de1579bb-d476-4d65-8af0-b4270ecc8a9b Sep 28 17:28:50 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-bea6419a-6636-4b5b-9959-36c257b64697 tempest-CreateVolumesFromImageTest-338088606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-bea6419a-6636-4b5b-9959-36c257b64697 tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-bea6419a-6636-4b5b-9959-36c257b64697 tempest-CreateVolumesFromImageTest-338088606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-bea6419a-6636-4b5b-9959-36c257b64697 tempest-CreateVolumesFromImageTest-338088606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-bea6419a-6636-4b5b-9959-36c257b64697 tempest-CreateVolumesFromImageTest-338088606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bea6419a-6636-4b5b-9959-36c257b64697 tempest-CreateVolumesFromImageTest-338088606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:50 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:28:50 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:50 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b8250cad-33fc-4bf0-bfea-fa81be4eb584 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3" returned: 0 in 0.458s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b8250cad-33fc-4bf0-bfea-fa81be4eb584 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:50 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3 Sep 28 17:28:50 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:50 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c9e791f8-d708-48a5-a38c-ad5a0e3ddc6e tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6614ae58-ef5e-4540-96bf-b8289ad800ff -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.de1579bb-d476-4d65-8af0-b4270ecc8a9b" returned: 0 in 0.377s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:50 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-c9e791f8-d708-48a5-a38c-ad5a0e3ddc6e tempest-ProjectMemberTests-584998297 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.de1579bb-d476-4d65-8af0-b4270ecc8a9b is being set with open permissions: ugo+rw Sep 28 17:28:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c9e791f8-d708-48a5-a38c-ad5a0e3ddc6e tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.de1579bb-d476-4d65-8af0-b4270ecc8a9b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:51 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.de1579bb-d476-4d65-8af0-b4270ecc8a9b Sep 28 17:28:51 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:51 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bea6419a-6636-4b5b-9959-36c257b64697 tempest-CreateVolumesFromImageTest-338088606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.387s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:51 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-bea6419a-6636-4b5b-9959-36c257b64697 tempest-CreateVolumesFromImageTest-338088606 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:51 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-bea6419a-6636-4b5b-9959-36c257b64697 tempest-CreateVolumesFromImageTest-338088606 None] Deleted volume successfully. Sep 28 17:28:51 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bea6419a-6636-4b5b-9959-36c257b64697 tempest-CreateVolumesFromImageTest-338088606 None] Lock "cinder-245e47ab-5cd0-46a0-9031-7c8f8206d102-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:51 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b8250cad-33fc-4bf0-bfea-fa81be4eb584 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3" returned: 0 in 0.377s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:51 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-b8250cad-33fc-4bf0-bfea-fa81be4eb584 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Lock "cinder-quobyte-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3" released by "delete_volume" :: held 0.897s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:51 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-b8250cad-33fc-4bf0-bfea-fa81be4eb584 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Created reservations ['00eb1b7c-6d3f-4d28-a041-c77b4b481d4f', 'c4479275-eb91-498e-b9e6-aa607ebf84d6', '984e6497-b6e5-4475-b4b6-98c76c8abacb', 'c7834039-6838-4b3a-a909-552130b905fe'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:51 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c9e791f8-d708-48a5-a38c-ad5a0e3ddc6e tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.de1579bb-d476-4d65-8af0-b4270ecc8a9b" returned: 0 in 0.338s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c9e791f8-d708-48a5-a38c-ad5a0e3ddc6e tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b8250cad-33fc-4bf0-bfea-fa81be4eb584 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b8250cad-33fc-4bf0-bfea-fa81be4eb584 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b8250cad-33fc-4bf0-bfea-fa81be4eb584 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b8250cad-33fc-4bf0-bfea-fa81be4eb584 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b8250cad-33fc-4bf0-bfea-fa81be4eb584 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b8250cad-33fc-4bf0-bfea-fa81be4eb584 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:51 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.info Sep 28 17:28:51 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:51 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:28:51 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:51 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c9e791f8-d708-48a5-a38c-ad5a0e3ddc6e tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.info" returned: 0 in 0.406s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:51 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-c9e791f8-d708-48a5-a38c-ad5a0e3ddc6e tempest-ProjectMemberTests-584998297 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.info is being set with open permissions: ugo+rw Sep 28 17:28:51 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c9e791f8-d708-48a5-a38c-ad5a0e3ddc6e tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b8250cad-33fc-4bf0-bfea-fa81be4eb584 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.395s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:51 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-b8250cad-33fc-4bf0-bfea-fa81be4eb584 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:51 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-b8250cad-33fc-4bf0-bfea-fa81be4eb584 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Deleted volume successfully. Sep 28 17:28:51 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.info Sep 28 17:28:51 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:51 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-b8250cad-33fc-4bf0-bfea-fa81be4eb584 tempest-VolumeAndVolumeTypeFromImageTest-2126862726 None] Lock "cinder-5cd998d6-9d43-43a1-8c7a-0aeaf5e8ddc3-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:52 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c9e791f8-d708-48a5-a38c-ad5a0e3ddc6e tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.info" returned: 0 in 0.354s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c9e791f8-d708-48a5-a38c-ad5a0e3ddc6e tempest-ProjectMemberTests-584998297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.652s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.707s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:52 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-329136476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061017b7-3cb0-435a-a7ef-67c6774cc6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d8463010cb4ad996ec1e17140bfa08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:47Z,use_quota=True,user_id='0b560e96d117438289613d5f807e131a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:52 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Creating volume 061017b7-3cb0-435a-a7ef-67c6774cc6ea {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:52 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:52 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:52 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:52 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:28:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-061017b7-3cb0-435a-a7ef-67c6774cc6ea 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:52 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-061017b7-3cb0-435a-a7ef-67c6774cc6ea 1073741824 Sep 28 17:28:52 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:52 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-c9e791f8-d708-48a5-a38c-ad5a0e3ddc6e tempest-ProjectMemberTests-584998297 None] Create snapshot completed successfully Sep 28 17:28:52 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-061017b7-3cb0-435a-a7ef-67c6774cc6ea 1073741824" returned: 0 in 0.617s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-061017b7-3cb0-435a-a7ef-67c6774cc6ea {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:52 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-061017b7-3cb0-435a-a7ef-67c6774cc6ea Sep 28 17:28:52 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:53 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-061017b7-3cb0-435a-a7ef-67c6774cc6ea" returned: 0 in 0.361s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.323s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-701464563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c21bb42f-0b35-457f-b203-c30b23e22ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d8463010cb4ad996ec1e17140bfa08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:48Z,use_quota=True,user_id='0b560e96d117438289613d5f807e131a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Creating volume c21bb42f-0b35-457f-b203-c30b23e22ed0 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:53 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c21bb42f-0b35-457f-b203-c30b23e22ed0 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb3a38e-422c-42df-969c-d2e2d734a09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-061017b7-3cb0-435a-a7ef-67c6774cc6ea', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af095837-b6b0-4c68-a8a2-5dc095ed57f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:53 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c21bb42f-0b35-457f-b203-c30b23e22ed0 1073741824 Sep 28 17:28:53 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Volume volume-061017b7-3cb0-435a-a7ef-67c6774cc6ea (061017b7-3cb0-435a-a7ef-67c6774cc6ea): created successfully Sep 28 17:28:53 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af095837-b6b0-4c68-a8a2-5dc095ed57f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Flow 'volume_create_manager' (69bfb453-7919-41cd-a251-1d56fc346ee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e7a14dff-c2b5-4193-ae10-6b914e959146 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-de1579bb-d476-4d65-8af0-b4270ecc8a9b-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:53 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-f721d73c-5889-4168-a4e6-84e111408b69 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Created volume successfully. Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e7a14dff-c2b5-4193-ae10-6b914e959146 tempest-ProjectMemberTests-584998297 None] Lock "cinder-de1579bb-d476-4d65-8af0-b4270ecc8a9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e7a14dff-c2b5-4193-ae10-6b914e959146 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-6614ae58-ef5e-4540-96bf-b8289ad800ff" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e7a14dff-c2b5-4193-ae10-6b914e959146 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-6614ae58-ef5e-4540-96bf-b8289ad800ff" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e7a14dff-c2b5-4193-ae10-6b914e959146 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-de1579bb-d476-4d65-8af0-b4270ecc8a9b" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e7a14dff-c2b5-4193-ae10-6b914e959146 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-de1579bb-d476-4d65-8af0-b4270ecc8a9b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-e7a14dff-c2b5-4193-ae10-6b914e959146 tempest-ProjectMemberTests-584998297 None] Deleting offline snapshot de1579bb-d476-4d65-8af0-b4270ecc8a9b of volume 6614ae58-ef5e-4540-96bf-b8289ad800ff {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-e7a14dff-c2b5-4193-ae10-6b914e959146 tempest-ProjectMemberTests-584998297 None] snapshot_file for this snap is: volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.de1579bb-d476-4d65-8af0-b4270ecc8a9b {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8b5404-dd5b-455f-ada0-2046e92e1862]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e7a14dff-c2b5-4193-ae10-6b914e959146 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.de1579bb-d476-4d65-8af0-b4270ecc8a9b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:53 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.de1579bb-d476-4d65-8af0-b4270ecc8a9b Sep 28 17:28:53 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:53 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e7a14dff-c2b5-4193-ae10-6b914e959146 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.de1579bb-d476-4d65-8af0-b4270ecc8a9b" returned: 0 in 0.503s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-e7a14dff-c2b5-4193-ae10-6b914e959146 tempest-ProjectMemberTests-584998297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6614ae58-ef5e-4540-96bf-b8289ad800ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:28:53 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c21bb42f-0b35-457f-b203-c30b23e22ed0 1073741824" returned: 0 in 0.792s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:54 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[01841329-7873-45e1-a64f-811772a86d30]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e7a14dff-c2b5-4193-ae10-6b914e959146 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c21bb42f-0b35-457f-b203-c30b23e22ed0 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:54 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c21bb42f-0b35-457f-b203-c30b23e22ed0 Sep 28 17:28:54 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:54 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff Sep 28 17:28:54 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:54 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c21bb42f-0b35-457f-b203-c30b23e22ed0" returned: 0 in 0.329s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:54 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:54 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5801ab0-6b96-4e7d-92ce-3aadbaeed06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c21bb42f-0b35-457f-b203-c30b23e22ed0', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:54 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd31e1b9-c8a3-4d27-a0e5-563e999a3226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:54 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Volume volume-c21bb42f-0b35-457f-b203-c30b23e22ed0 (c21bb42f-0b35-457f-b203-c30b23e22ed0): created successfully Sep 28 17:28:54 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd31e1b9-c8a3-4d27-a0e5-563e999a3226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:54 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Flow 'volume_create_manager' (15f7a4bc-d08b-4b60-bd8f-1c9e1624fa69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:54 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-251faa71-8617-44e9-910b-e0d04f284f60 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Created volume successfully. Sep 28 17:28:54 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e7a14dff-c2b5-4193-ae10-6b914e959146 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff" returned: 0 in 0.541s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e7a14dff-c2b5-4193-ae10-6b914e959146 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.de1579bb-d476-4d65-8af0-b4270ecc8a9b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:54 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.de1579bb-d476-4d65-8af0-b4270ecc8a9b Sep 28 17:28:54 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:54 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-dcae7484-a192-407c-9560-2eb1950f19f8 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "cinder-c21bb42f-0b35-457f-b203-c30b23e22ed0-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:54 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-dcae7484-a192-407c-9560-2eb1950f19f8 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-c21bb42f-0b35-457f-b203-c30b23e22ed0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:54 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-dcae7484-a192-407c-9560-2eb1950f19f8 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "cinder-quobyte-c21bb42f-0b35-457f-b203-c30b23e22ed0" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:54 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-dcae7484-a192-407c-9560-2eb1950f19f8 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-quobyte-c21bb42f-0b35-457f-b203-c30b23e22ed0" acquired by "delete_volume" :: waited 0.021s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:54 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[32323029-c794-4a6b-96e0-afeab19f53e6]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dcae7484-a192-407c-9560-2eb1950f19f8 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c21bb42f-0b35-457f-b203-c30b23e22ed0 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:55 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c21bb42f-0b35-457f-b203-c30b23e22ed0 Sep 28 17:28:55 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:55 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e7a14dff-c2b5-4193-ae10-6b914e959146 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.de1579bb-d476-4d65-8af0-b4270ecc8a9b" returned: 0 in 0.609s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e7a14dff-c2b5-4193-ae10-6b914e959146 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.de1579bb-d476-4d65-8af0-b4270ecc8a9b {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:55 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.de1579bb-d476-4d65-8af0-b4270ecc8a9b Sep 28 17:28:55 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:55 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dcae7484-a192-407c-9560-2eb1950f19f8 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c21bb42f-0b35-457f-b203-c30b23e22ed0" returned: 0 in 0.528s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dcae7484-a192-407c-9560-2eb1950f19f8 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c21bb42f-0b35-457f-b203-c30b23e22ed0 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:55 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c21bb42f-0b35-457f-b203-c30b23e22ed0 Sep 28 17:28:55 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:55 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e7a14dff-c2b5-4193-ae10-6b914e959146 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff.de1579bb-d476-4d65-8af0-b4270ecc8a9b" returned: 0 in 0.420s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:55 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e7a14dff-c2b5-4193-ae10-6b914e959146 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-de1579bb-d476-4d65-8af0-b4270ecc8a9b" released by "_delete_snapshot" :: held 2.241s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:55 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e7a14dff-c2b5-4193-ae10-6b914e959146 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-6614ae58-ef5e-4540-96bf-b8289ad800ff" released by "delete_snapshot" :: held 2.274s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:55 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dcae7484-a192-407c-9560-2eb1950f19f8 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c21bb42f-0b35-457f-b203-c30b23e22ed0" returned: 0 in 0.331s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:55 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-dcae7484-a192-407c-9560-2eb1950f19f8 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-quobyte-c21bb42f-0b35-457f-b203-c30b23e22ed0" released by "delete_volume" :: held 0.930s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:55 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-e7a14dff-c2b5-4193-ae10-6b914e959146 tempest-ProjectMemberTests-584998297 None] Created reservations ['dcb0362a-bdb0-4ec4-8dd8-b0e7ae263645', 'b5a3ef2e-336d-48ba-9077-8750a6d22304', 'dbb0b2be-a07a-4f2d-a5e8-70cf7f7b4431', 'ef5b3c14-1400-4dde-ac28-804a7a0a8370'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:55 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e7a14dff-c2b5-4193-ae10-6b914e959146 tempest-ProjectMemberTests-584998297 None] Delete snapshot completed successfully. Sep 28 17:28:55 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e7a14dff-c2b5-4193-ae10-6b914e959146 tempest-ProjectMemberTests-584998297 None] Lock "cinder-de1579bb-d476-4d65-8af0-b4270ecc8a9b-delete_snapshot" released by "delete_snapshot" :: held 2.548s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:55 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-dcae7484-a192-407c-9560-2eb1950f19f8 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Created reservations ['3f49ac5e-fac2-4d42-9207-81731926ad94', 'c7dfe50d-9f97-4ffb-853b-839ce99311bb', '5b04ae1b-57d4-4864-a877-f30b27c7aad7', 'ea7bbdbd-4025-4d64-bc52-14dea2f62c7b'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-dcae7484-a192-407c-9560-2eb1950f19f8 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-dcae7484-a192-407c-9560-2eb1950f19f8 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:56 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-dcae7484-a192-407c-9560-2eb1950f19f8 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:56 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-dcae7484-a192-407c-9560-2eb1950f19f8 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-dcae7484-a192-407c-9560-2eb1950f19f8 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dcae7484-a192-407c-9560-2eb1950f19f8 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:56 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:28:56 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:56 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dcae7484-a192-407c-9560-2eb1950f19f8 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.305s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:56 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-dcae7484-a192-407c-9560-2eb1950f19f8 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:56 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-dcae7484-a192-407c-9560-2eb1950f19f8 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Deleted volume successfully. Sep 28 17:28:56 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-dcae7484-a192-407c-9560-2eb1950f19f8 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-c21bb42f-0b35-457f-b203-c30b23e22ed0-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:56 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-090d0106-d88e-4ab6-a6d4-6ab57768246e tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-6614ae58-ef5e-4540-96bf-b8289ad800ff-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:56 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-090d0106-d88e-4ab6-a6d4-6ab57768246e tempest-ProjectMemberTests-584998297 None] Lock "cinder-6614ae58-ef5e-4540-96bf-b8289ad800ff-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:56 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-090d0106-d88e-4ab6-a6d4-6ab57768246e tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-6614ae58-ef5e-4540-96bf-b8289ad800ff" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:56 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-090d0106-d88e-4ab6-a6d4-6ab57768246e tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-6614ae58-ef5e-4540-96bf-b8289ad800ff" acquired by "delete_volume" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:56 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[313a7e92-8089-46d6-8bef-227bbfd0ef19]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-090d0106-d88e-4ab6-a6d4-6ab57768246e tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:56 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff Sep 28 17:28:56 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fd43ea31-bd77-4f0c-8bd8-becc6a31804d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "cinder-061017b7-3cb0-435a-a7ef-67c6774cc6ea-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fd43ea31-bd77-4f0c-8bd8-becc6a31804d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-061017b7-3cb0-435a-a7ef-67c6774cc6ea-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fd43ea31-bd77-4f0c-8bd8-becc6a31804d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "cinder-quobyte-061017b7-3cb0-435a-a7ef-67c6774cc6ea" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fd43ea31-bd77-4f0c-8bd8-becc6a31804d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-quobyte-061017b7-3cb0-435a-a7ef-67c6774cc6ea" acquired by "delete_volume" :: waited 0.021s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:57 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[374d57e3-6072-46e5-957c-f54ac17278ce]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fd43ea31-bd77-4f0c-8bd8-becc6a31804d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-061017b7-3cb0-435a-a7ef-67c6774cc6ea {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:57 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-090d0106-d88e-4ab6-a6d4-6ab57768246e tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff" returned: 0 in 0.518s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-090d0106-d88e-4ab6-a6d4-6ab57768246e tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:57 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff Sep 28 17:28:57 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:57 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-061017b7-3cb0-435a-a7ef-67c6774cc6ea Sep 28 17:28:57 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:57 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-090d0106-d88e-4ab6-a6d4-6ab57768246e tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6614ae58-ef5e-4540-96bf-b8289ad800ff" returned: 0 in 0.424s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-090d0106-d88e-4ab6-a6d4-6ab57768246e tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-6614ae58-ef5e-4540-96bf-b8289ad800ff" released by "delete_volume" :: held 1.039s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:57 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:57 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Flow 'volume_create_manager' (d44c4fc6-03ae-4e18-b99a-53b3975c6638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e65ac4-faaf-4f46-9e42-1eebee0155fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fd43ea31-bd77-4f0c-8bd8-becc6a31804d tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-061017b7-3cb0-435a-a7ef-67c6774cc6ea" returned: 0 in 0.685s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fd43ea31-bd77-4f0c-8bd8-becc6a31804d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-061017b7-3cb0-435a-a7ef-67c6774cc6ea {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:57 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-061017b7-3cb0-435a-a7ef-67c6774cc6ea Sep 28 17:28:57 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e65ac4-faaf-4f46-9e42-1eebee0155fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-297244146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22cab4e6ac194c4c8ff4c85727aacb85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:58Z,use_quota=True,user_id='451a3d2ed2fc4a36afd0a50d496d0fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b4dbaf-e608-42c2-9a47-5df2ccb1ee3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b4dbaf-e608-42c2-9a47-5df2ccb1ee3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de00966-3b78-498b-b240-d35467d72489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de00966-3b78-498b-b240-d35467d72489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2', 'volume_name': 'volume-14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111e1c1e-1b62-44be-9df3-ae39e273de4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111e1c1e-1b62-44be-9df3-ae39e273de4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b246cecc-2245-40c5-bd23-9be33e1de0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:58 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Volume 14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2', 'volume_size': 1} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-297244146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22cab4e6ac194c4c8ff4c85727aacb85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:58Z,use_quota=True,user_id='451a3d2ed2fc4a36afd0a50d496d0fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Creating volume 14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:58 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-090d0106-d88e-4ab6-a6d4-6ab57768246e tempest-ProjectMemberTests-584998297 None] Created reservations ['12dbdee9-fd31-4d85-a0b0-fd3f06c38c74', '2c3ab6ca-e23d-4aa9-9e84-37372e66b575', 'd37c3550-9ce2-485e-92e6-4b86c5dd1c3e', '7ed9202b-0faa-4e0c-8681-bec25e32d2ee'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:58 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2 1073741824 Sep 28 17:28:58 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-090d0106-d88e-4ab6-a6d4-6ab57768246e tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-090d0106-d88e-4ab6-a6d4-6ab57768246e tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-090d0106-d88e-4ab6-a6d4-6ab57768246e tempest-ProjectMemberTests-584998297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-090d0106-d88e-4ab6-a6d4-6ab57768246e tempest-ProjectMemberTests-584998297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-090d0106-d88e-4ab6-a6d4-6ab57768246e tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-090d0106-d88e-4ab6-a6d4-6ab57768246e tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:58 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:28:58 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:58 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fd43ea31-bd77-4f0c-8bd8-becc6a31804d tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-061017b7-3cb0-435a-a7ef-67c6774cc6ea" returned: 0 in 0.378s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fd43ea31-bd77-4f0c-8bd8-becc6a31804d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-quobyte-061017b7-3cb0-435a-a7ef-67c6774cc6ea" released by "delete_volume" :: held 1.133s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-fd43ea31-bd77-4f0c-8bd8-becc6a31804d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Created reservations ['4a424cdb-56e1-4c77-aed5-4598cdb3766b', 'a6ba9abe-e193-4a8d-a8ad-c486e939a8f4', 'ad7bb3f9-9442-4cf9-8985-ff012a93a919', '3f32e82f-0beb-4461-a63c-7300f2a9cf74'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:58 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-090d0106-d88e-4ab6-a6d4-6ab57768246e tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.328s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-090d0106-d88e-4ab6-a6d4-6ab57768246e tempest-ProjectMemberTests-584998297 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:58 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-090d0106-d88e-4ab6-a6d4-6ab57768246e tempest-ProjectMemberTests-584998297 None] Deleted volume successfully. Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fd43ea31-bd77-4f0c-8bd8-becc6a31804d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fd43ea31-bd77-4f0c-8bd8-becc6a31804d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fd43ea31-bd77-4f0c-8bd8-becc6a31804d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fd43ea31-bd77-4f0c-8bd8-becc6a31804d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fd43ea31-bd77-4f0c-8bd8-becc6a31804d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fd43ea31-bd77-4f0c-8bd8-becc6a31804d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-090d0106-d88e-4ab6-a6d4-6ab57768246e tempest-ProjectMemberTests-584998297 None] Lock "cinder-6614ae58-ef5e-4540-96bf-b8289ad800ff-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:58 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:28:58 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:58 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2 1073741824" returned: 0 in 0.745s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:58 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2 Sep 28 17:28:58 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:58 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fd43ea31-bd77-4f0c-8bd8-becc6a31804d tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.423s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:58 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-fd43ea31-bd77-4f0c-8bd8-becc6a31804d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:58 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-fd43ea31-bd77-4f0c-8bd8-becc6a31804d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Deleted volume successfully. Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fd43ea31-bd77-4f0c-8bd8-becc6a31804d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-061017b7-3cb0-435a-a7ef-67c6774cc6ea-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Flow 'volume_create_manager' (4b622946-3205-4fed-9ca0-8dc54ee35320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ddeb8a-42f1-4ad1-bc8a-6d9ecfc3aada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ddeb8a-42f1-4ad1-bc8a-6d9ecfc3aada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ec4276-1188-4091-9680-41bef0aa6503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616653217dac42328919ce305f6b8784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:59Z,use_quota=True,user_id='8ba16714d7924f6495b29fac966d2d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73806f26-7b61-42c7-a084-731276fef4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73806f26-7b61-42c7-a084-731276fef4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:59 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ca1b07-c567-43f8-8906-dda3bb4e3cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.image.glance [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Creating Keystone auth plugin from conf {{(pid=87061) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2" returned: 0 in 0.404s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b246cecc-2245-40c5-bd23-9be33e1de0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83761a44-bff8-4843-bbb0-4998df8864c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:59 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Volume volume-14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2 (14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2): created successfully Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83761a44-bff8-4843-bbb0-4998df8864c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Flow 'volume_create_manager' (d44c4fc6-03ae-4e18-b99a-53b3975c6638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:59 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-ca72e64f-5a2a-4d7b-b3ac-dcf9fca0cd9b tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Created volume successfully. Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ece979f7-c816-420b-ad40-04ea91c3cff6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "cinder-2b03e88d-72d6-48c8-b06e-c0878dec81af-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ece979f7-c816-420b-ad40-04ea91c3cff6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-2b03e88d-72d6-48c8-b06e-c0878dec81af-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ece979f7-c816-420b-ad40-04ea91c3cff6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "cinder-quobyte-2b03e88d-72d6-48c8-b06e-c0878dec81af" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ece979f7-c816-420b-ad40-04ea91c3cff6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-quobyte-2b03e88d-72d6-48c8-b06e-c0878dec81af" acquired by "delete_volume" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c25acd-7097-417d-9f3a-c91c05fc5597]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ece979f7-c816-420b-ad40-04ea91c3cff6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2b03e88d-72d6-48c8-b06e-c0878dec81af {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Flow 'volume_create_manager' (1abf9ae3-71cd-47f5-afdf-69f82afe9e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff55b2dd-a5aa-46b2-897c-bf08ca40d793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff55b2dd-a5aa-46b2-897c-bf08ca40d793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1180456765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b066f10-7039-409c-ba03-7f69af0fbfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716b289f0179458f8e2e869e7ff71485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:00Z,use_quota=True,user_id='ccaca5bfad8b4b96b2ae3b66012f813b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0363ec0f-8f1f-4f53-ba2f-d06a4fdeba18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:59 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2b03e88d-72d6-48c8-b06e-c0878dec81af Sep 28 17:28:59 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0363ec0f-8f1f-4f53-ba2f-d06a4fdeba18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f18bd34d-a98a-463e-b833-40b50c744698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f18bd34d-a98a-463e-b833-40b50c744698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b066f10-7039-409c-ba03-7f69af0fbfa9', 'volume_name': 'volume-7b066f10-7039-409c-ba03-7f69af0fbfa9', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72c3cf9-a066-480f-9e15-34576b48ccf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72c3cf9-a066-480f-9e15-34576b48ccf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (353c20c7-94e9-4f62-9aa5-b81a4c4c9560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:59 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Volume 7b066f10-7039-409c-ba03-7f69af0fbfa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b066f10-7039-409c-ba03-7f69af0fbfa9', 'volume_size': 1} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1180456765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b066f10-7039-409c-ba03-7f69af0fbfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716b289f0179458f8e2e869e7ff71485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:00Z,use_quota=True,user_id='ccaca5bfad8b4b96b2ae3b66012f813b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Creating volume 7b066f10-7039-409c-ba03-7f69af0fbfa9 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:59 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:59 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9 1073741824 Sep 28 17:28:59 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ca1b07-c567-43f8-8906-dda3bb4e3cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e0ec4276-1188-4091-9680-41bef0aa6503', 'volume_name': 'volume-e0ec4276-1188-4091-9680-41bef0aa6503', 'volume_size': 1, 'image_id': 'f9e65718-3957-420a-a03f-93ceb13e9169', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9e65718-3957-420a-a03f-93ceb13e9169', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e0e4a6e8b85000a6de50668540d15903', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '616653217dac42328919ce305f6b8784', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c3df3df56f3b9d46cb013ffb4a8a59458ee0a913158dff38359c6b5abd012e1c05ad0933613993f96cbc3fa220d4b1374c25a637d663802aca036d6a7b52f1bd', 'id': 'f9e65718-3957-420a-a03f-93ceb13e9169', 'created_at': datetime.datetime(2026, 9, 28, 15, 28, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 28, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9e65718-3957-420a-a03f-93ceb13e9169/file', 'properties': {}}, 'image_service': }' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9776ecce-7f42-4c54-bb6a-6d721ad641a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9776ecce-7f42-4c54-bb6a-6d721ad641a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748d4571-c7e8-4671-bb49-1354e8d5be84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:59 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Volume e0ec4276-1188-4091-9680-41bef0aa6503: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e0ec4276-1188-4091-9680-41bef0aa6503', 'volume_size': 1, 'image_id': 'f9e65718-3957-420a-a03f-93ceb13e9169', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9e65718-3957-420a-a03f-93ceb13e9169', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e0e4a6e8b85000a6de50668540d15903', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '616653217dac42328919ce305f6b8784', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c3df3df56f3b9d46cb013ffb4a8a59458ee0a913158dff38359c6b5abd012e1c05ad0933613993f96cbc3fa220d4b1374c25a637d663802aca036d6a7b52f1bd', 'id': 'f9e65718-3957-420a-a03f-93ceb13e9169', 'created_at': datetime.datetime(2026, 9, 28, 15, 28, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 28, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9e65718-3957-420a-a03f-93ceb13e9169/file', 'properties': {}}, 'image_service': } Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Trying to clone e0ec4276-1188-4091-9680-41bef0aa6503 from image f9e65718-3957-420a-a03f-93ceb13e9169 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f9e65718-3957-420a-a03f-93ceb13e9169', 'metadata': {}}]). {{(pid=87061) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:28:59 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:28:59 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:29:00 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ece979f7-c816-420b-ad40-04ea91c3cff6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2b03e88d-72d6-48c8-b06e-c0878dec81af" returned: 0 in 0.499s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ece979f7-c816-420b-ad40-04ea91c3cff6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2b03e88d-72d6-48c8-b06e-c0878dec81af {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e473445-b916-405a-84f8-d005647496a2]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:00 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2b03e88d-72d6-48c8-b06e-c0878dec81af Sep 28 17:29:00 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:00 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD Sep 28 17:29:00 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:00 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9 1073741824" returned: 0 in 0.671s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:00 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ece979f7-c816-420b-ad40-04ea91c3cff6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2b03e88d-72d6-48c8-b06e-c0878dec81af" returned: 0 in 0.396s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ece979f7-c816-420b-ad40-04ea91c3cff6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-quobyte-2b03e88d-72d6-48c8-b06e-c0878dec81af" released by "delete_volume" :: held 0.955s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Flow 'volume_create_manager' (1fee4bc8-eba8-4698-aea5-9303a75665c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aac2c28-a940-475c-884e-fba2cf40d06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:00 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD" returned: 0 in 0.510s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aac2c28-a940-475c-884e-fba2cf40d06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1367041643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca15f12-a1af-463a-878d-d448ffcf244d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22cab4e6ac194c4c8ff4c85727aacb85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:00Z,use_quota=True,user_id='451a3d2ed2fc4a36afd0a50d496d0fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:00 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9 Sep 28 17:29:00 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c627d9a8-450b-4ab3-bb7c-50d56e05e084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c627d9a8-450b-4ab3-bb7c-50d56e05e084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fbddb81-bd79-42c1-a788-4402e92b0fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fbddb81-bd79-42c1-a788-4402e92b0fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ca15f12-a1af-463a-878d-d448ffcf244d', 'volume_name': 'volume-6ca15f12-a1af-463a-878d-d448ffcf244d', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7860210f-7104-430b-a5a6-f89e339f4b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7860210f-7104-430b-a5a6-f89e339f4b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51925cf8-2d68-4f66-90bf-75eae0c56c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:00 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Volume 6ca15f12-a1af-463a-878d-d448ffcf244d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ca15f12-a1af-463a-878d-d448ffcf244d', 'volume_size': 1} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-ece979f7-c816-420b-ad40-04ea91c3cff6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Created reservations ['2a7ac1d9-a7e8-4256-93cb-a2bf186f50a5', 'b4ab9639-2318-4fe2-a08a-f3eb93dce06a', '3951bb44-cfb3-4016-bbb2-f7517f1fbf6a', '7ea814bb-7ac0-4f22-9750-1ba100a24029'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:00 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD Sep 28 17:29:00 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ece979f7-c816-420b-ad40-04ea91c3cff6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ece979f7-c816-420b-ad40-04ea91c3cff6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ece979f7-c816-420b-ad40-04ea91c3cff6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ece979f7-c816-420b-ad40-04ea91c3cff6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ece979f7-c816-420b-ad40-04ea91c3cff6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ece979f7-c816-420b-ad40-04ea91c3cff6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:00 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:00 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Flow 'volume_create_manager' (446c80fd-74b2-4506-aa41-d173bbf5180d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e837b146-770c-44d5-bef5-346ed9b15683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e837b146-770c-44d5-bef5-346ed9b15683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-959752976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fdbac24-9762-47d5-a999-3efc16b927b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22cab4e6ac194c4c8ff4c85727aacb85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:01Z,use_quota=True,user_id='451a3d2ed2fc4a36afd0a50d496d0fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:01 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e82deca0-2f1a-492b-88ca-cbcddc2257c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e82deca0-2f1a-492b-88ca-cbcddc2257c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13158f5c-cd75-4fb9-a591-2f1a8d03ff72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13158f5c-cd75-4fb9-a591-2f1a8d03ff72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fdbac24-9762-47d5-a999-3efc16b927b5', 'volume_name': 'volume-8fdbac24-9762-47d5-a999-3efc16b927b5', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d761caa7-de12-419d-8948-51762f0c1b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d761caa7-de12-419d-8948-51762f0c1b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d41fef-0dca-4b9a-abee-54be928d2318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:01 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Volume 8fdbac24-9762-47d5-a999-3efc16b927b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fdbac24-9762-47d5-a999-3efc16b927b5', 'volume_size': 1} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9" returned: 0 in 0.571s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.494s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1367041643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca15f12-a1af-463a-878d-d448ffcf244d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22cab4e6ac194c4c8ff4c85727aacb85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:00Z,use_quota=True,user_id='451a3d2ed2fc4a36afd0a50d496d0fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Creating volume 6ca15f12-a1af-463a-878d-d448ffcf244d {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:01 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6ca15f12-a1af-463a-878d-d448ffcf244d 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:01 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ece979f7-c816-420b-ad40-04ea91c3cff6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.381s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-ece979f7-c816-420b-ad40-04ea91c3cff6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:01 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6ca15f12-a1af-463a-878d-d448ffcf244d 1073741824 Sep 28 17:29:01 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-ece979f7-c816-420b-ad40-04ea91c3cff6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Deleted volume successfully. Sep 28 17:29:01 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (353c20c7-94e9-4f62-9aa5-b81a4c4c9560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b066f10-7039-409c-ba03-7f69af0fbfa9', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7460eeca-3e95-4eb1-96e3-321307d767e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:01 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD" returned: 1 in 0.662s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Temporary image f9e65718-3957-420a-a03f-93ceb13e9169 is fetched for user 8ba16714d7924f6495b29fac966d2d3b. {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:29:01 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Volume volume-7b066f10-7039-409c-ba03-7f69af0fbfa9 (7b066f10-7039-409c-ba03-7f69af0fbfa9): created successfully Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7460eeca-3e95-4eb1-96e3-321307d767e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Flow 'volume_create_manager' (1abf9ae3-71cd-47f5-afdf-69f82afe9e6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ece979f7-c816-420b-ad40-04ea91c3cff6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-2b03e88d-72d6-48c8-b06e-c0878dec81af-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:01 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-05386a2f-e4eb-41a8-9497-063b0cbe7f7c tempest-ProjectMemberTests-584998297 None] Created volume successfully. Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b12d31-5ac3-4619-a6cb-f93b4bf6f3b6]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:01 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD Sep 28 17:29:01 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Flow 'volume_create_manager' (99859305-5657-457e-a225-28181d0b5b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbb0a19-c41e-479d-95a5-3555bc7aee80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbb0a19-c41e-479d-95a5-3555bc7aee80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-993604934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a960e5-c08c-4efa-bb98-21a7de4345f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22cab4e6ac194c4c8ff4c85727aacb85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:01Z,use_quota=True,user_id='451a3d2ed2fc4a36afd0a50d496d0fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c3ce11d-4b9c-40d4-b0ca-877c94516423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c3ce11d-4b9c-40d4-b0ca-877c94516423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118fcdd0-db37-49f1-8a8c-f8cc09f61a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118fcdd0-db37-49f1-8a8c-f8cc09f61a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1a960e5-c08c-4efa-bb98-21a7de4345f1', 'volume_name': 'volume-f1a960e5-c08c-4efa-bb98-21a7de4345f1', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bdcbd42-278a-4a3d-90d1-ffe0a9a3fbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bdcbd42-278a-4a3d-90d1-ffe0a9a3fbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab430997-f767-408e-9f81-134e3cd7aeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:01 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Volume f1a960e5-c08c-4efa-bb98-21a7de4345f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1a960e5-c08c-4efa-bb98-21a7de4345f1', 'volume_size': 1} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:01 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-73c0b02e-02c0-4153-a705-6885e8b6a73d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "cinder-e98e1c21-4c63-4989-bbb8-23f98f8d4dab-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD" returned: 0 in 0.504s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-73c0b02e-02c0-4153-a705-6885e8b6a73d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-e98e1c21-4c63-4989-bbb8-23f98f8d4dab-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:01 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6ca15f12-a1af-463a-878d-d448ffcf244d 1073741824" returned: 0 in 0.773s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:02 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-73c0b02e-02c0-4153-a705-6885e8b6a73d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "cinder-quobyte-e98e1c21-4c63-4989-bbb8-23f98f8d4dab" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:02 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6ca15f12-a1af-463a-878d-d448ffcf244d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:02 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6ca15f12-a1af-463a-878d-d448ffcf244d Sep 28 17:29:02 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Flow 'volume_create_manager' (1e41796c-9ef0-421b-b06d-6100ccd20b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36265072-1b0b-400e-b4ef-47c616d0a3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-73c0b02e-02c0-4153-a705-6885e8b6a73d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-quobyte-e98e1c21-4c63-4989-bbb8-23f98f8d4dab" acquired by "delete_volume" :: waited 0.123s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36265072-1b0b-400e-b4ef-47c616d0a3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1721077535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb69db0-b315-4e12-a74a-d12908ba4516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22cab4e6ac194c4c8ff4c85727aacb85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:02Z,use_quota=True,user_id='451a3d2ed2fc4a36afd0a50d496d0fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4677db0-2e2a-4b75-827b-251e9bf3d534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4677db0-2e2a-4b75-827b-251e9bf3d534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c07c6a-1e9f-4d25-b49d-682c9e6f313c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c07c6a-1e9f-4d25-b49d-682c9e6f313c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fb69db0-b315-4e12-a74a-d12908ba4516', 'volume_name': 'volume-3fb69db0-b315-4e12-a74a-d12908ba4516', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c63dc0-0469-445b-b175-fae2a29cccdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c63dc0-0469-445b-b175-fae2a29cccdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17234b74-297b-46df-83d7-7b4d3e9e6391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:02 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Volume 3fb69db0-b315-4e12-a74a-d12908ba4516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fb69db0-b315-4e12-a74a-d12908ba4516', 'volume_size': 1} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e34248e-fae2-4d98-954c-c06a47d09d78]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-73c0b02e-02c0-4153-a705-6885e8b6a73d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e98e1c21-4c63-4989-bbb8-23f98f8d4dab {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:02 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:02 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD" returned: 1 in 0.585s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6ca15f12-a1af-463a-878d-d448ffcf244d" returned: 0 in 0.396s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:02 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e98e1c21-4c63-4989-bbb8-23f98f8d4dab Sep 28 17:29:02 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.331s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-959752976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fdbac24-9762-47d5-a999-3efc16b927b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22cab4e6ac194c4c8ff4c85727aacb85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:01Z,use_quota=True,user_id='451a3d2ed2fc4a36afd0a50d496d0fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Creating volume 8fdbac24-9762-47d5-a999-3efc16b927b5 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:02 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8fdbac24-9762-47d5-a999-3efc16b927b5 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:02 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8fdbac24-9762-47d5-a999-3efc16b927b5 1073741824 Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51925cf8-2d68-4f66-90bf-75eae0c56c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca15f12-a1af-463a-878d-d448ffcf244d', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:02 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7396987-dc9c-46d8-bf7a-dc45d24d99e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:02 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Volume volume-6ca15f12-a1af-463a-878d-d448ffcf244d (6ca15f12-a1af-463a-878d-d448ffcf244d): created successfully Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7396987-dc9c-46d8-bf7a-dc45d24d99e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Flow 'volume_create_manager' (1fee4bc8-eba8-4698-aea5-9303a75665c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:02 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-b7922500-6eef-41fb-82fc-da304023e4e3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Created volume successfully. Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8a194214-4d0b-42c0-a01c-3a820e3168e4 tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Flow 'volume_create_manager' (f656d63a-debc-4ed7-8dcc-a07f8f2ee0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f0bd4d-3be8-4bca-bb2a-5547bc85bd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f0bd4d-3be8-4bca-bb2a-5547bc85bd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2021859210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e1ddc5a-9822-4d25-80ff-88623abafac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22cab4e6ac194c4c8ff4c85727aacb85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:03Z,use_quota=True,user_id='451a3d2ed2fc4a36afd0a50d496d0fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77612aa0-0801-410a-8ccf-60914a6ab245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77612aa0-0801-410a-8ccf-60914a6ab245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4484599-1644-4222-8737-0c11bb408a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:02 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4484599-1644-4222-8737-0c11bb408a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e1ddc5a-9822-4d25-80ff-88623abafac9', 'volume_name': 'volume-6e1ddc5a-9822-4d25-80ff-88623abafac9', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3c334a-dcba-42dc-816a-a21ac15e0edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3c334a-dcba-42dc-816a-a21ac15e0edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1fa744-fe82-4050-9f16-21f71c627bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:02 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Volume 6e1ddc5a-9822-4d25-80ff-88623abafac9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e1ddc5a-9822-4d25-80ff-88623abafac9', 'volume_size': 1} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-73c0b02e-02c0-4153-a705-6885e8b6a73d tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e98e1c21-4c63-4989-bbb8-23f98f8d4dab" returned: 0 in 0.509s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-73c0b02e-02c0-4153-a705-6885e8b6a73d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e98e1c21-4c63-4989-bbb8-23f98f8d4dab {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:02 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e98e1c21-4c63-4989-bbb8-23f98f8d4dab Sep 28 17:29:02 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:03 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8fdbac24-9762-47d5-a999-3efc16b927b5 1073741824" returned: 0 in 0.600s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:03 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-73c0b02e-02c0-4153-a705-6885e8b6a73d tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e98e1c21-4c63-4989-bbb8-23f98f8d4dab" returned: 0 in 0.314s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8fdbac24-9762-47d5-a999-3efc16b927b5 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-73c0b02e-02c0-4153-a705-6885e8b6a73d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-quobyte-e98e1c21-4c63-4989-bbb8-23f98f8d4dab" released by "delete_volume" :: held 0.984s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:03 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8fdbac24-9762-47d5-a999-3efc16b927b5 Sep 28 17:29:03 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-73c0b02e-02c0-4153-a705-6885e8b6a73d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Created reservations ['abef29fc-08d1-479f-b9d0-f8bbc75596b6', 'f5f29c92-7f95-47e8-8ac8-44a7458a7c01', 'bd1648d7-9a49-456b-9bf9-6e0fb82d5eb0', '09aa8db7-d0aa-4f60-94d0-05be8ff7002d'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-73c0b02e-02c0-4153-a705-6885e8b6a73d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-73c0b02e-02c0-4153-a705-6885e8b6a73d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-73c0b02e-02c0-4153-a705-6885e8b6a73d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-73c0b02e-02c0-4153-a705-6885e8b6a73d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-73c0b02e-02c0-4153-a705-6885e8b6a73d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-73c0b02e-02c0-4153-a705-6885e8b6a73d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:03 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:03 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:03 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8fdbac24-9762-47d5-a999-3efc16b927b5" returned: 0 in 0.314s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.815s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-993604934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a960e5-c08c-4efa-bb98-21a7de4345f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22cab4e6ac194c4c8ff4c85727aacb85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:01Z,use_quota=True,user_id='451a3d2ed2fc4a36afd0a50d496d0fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Creating volume f1a960e5-c08c-4efa-bb98-21a7de4345f1 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:03 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f1a960e5-c08c-4efa-bb98-21a7de4345f1 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e277df88-049b-433e-aeea-19f803c096f6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "cinder-cbb9925c-0a22-41ea-9f8d-8380484ce294-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d41fef-0dca-4b9a-abee-54be928d2318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fdbac24-9762-47d5-a999-3efc16b927b5', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8623dc2d-e77d-4b09-aabe-85b3c29b780a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:03 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f1a960e5-c08c-4efa-bb98-21a7de4345f1 1073741824 Sep 28 17:29:03 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e277df88-049b-433e-aeea-19f803c096f6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-cbb9925c-0a22-41ea-9f8d-8380484ce294-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:03 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Volume volume-8fdbac24-9762-47d5-a999-3efc16b927b5 (8fdbac24-9762-47d5-a999-3efc16b927b5): created successfully Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8623dc2d-e77d-4b09-aabe-85b3c29b780a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Flow 'volume_create_manager' (446c80fd-74b2-4506-aa41-d173bbf5180d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:03 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-f312558d-c96a-4cf4-9414-d08054fc848d tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Created volume successfully. Sep 28 17:29:03 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-73c0b02e-02c0-4153-a705-6885e8b6a73d tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.339s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-73c0b02e-02c0-4153-a705-6885e8b6a73d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e277df88-049b-433e-aeea-19f803c096f6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "cinder-quobyte-cbb9925c-0a22-41ea-9f8d-8380484ce294" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:03 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-73c0b02e-02c0-4153-a705-6885e8b6a73d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Deleted volume successfully. Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-73c0b02e-02c0-4153-a705-6885e8b6a73d tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-e98e1c21-4c63-4989-bbb8-23f98f8d4dab-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e277df88-049b-433e-aeea-19f803c096f6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-quobyte-cbb9925c-0a22-41ea-9f8d-8380484ce294" acquired by "delete_volume" :: waited 0.034s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[2291f9df-9d30-4e7f-a0a5-47286939c0ca]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e277df88-049b-433e-aeea-19f803c096f6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cbb9925c-0a22-41ea-9f8d-8380484ce294 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:03 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cbb9925c-0a22-41ea-9f8d-8380484ce294 Sep 28 17:29:03 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:04 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f1a960e5-c08c-4efa-bb98-21a7de4345f1 1073741824" returned: 0 in 0.583s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f1a960e5-c08c-4efa-bb98-21a7de4345f1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:04 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f1a960e5-c08c-4efa-bb98-21a7de4345f1 Sep 28 17:29:04 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:04 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e277df88-049b-433e-aeea-19f803c096f6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cbb9925c-0a22-41ea-9f8d-8380484ce294" returned: 0 in 0.452s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e277df88-049b-433e-aeea-19f803c096f6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cbb9925c-0a22-41ea-9f8d-8380484ce294 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:04 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cbb9925c-0a22-41ea-9f8d-8380484ce294 Sep 28 17:29:04 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:04 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f1a960e5-c08c-4efa-bb98-21a7de4345f1" returned: 0 in 0.277s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.086s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1721077535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb69db0-b315-4e12-a74a-d12908ba4516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22cab4e6ac194c4c8ff4c85727aacb85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:02Z,use_quota=True,user_id='451a3d2ed2fc4a36afd0a50d496d0fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Creating volume 3fb69db0-b315-4e12-a74a-d12908ba4516 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:04 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fb69db0-b315-4e12-a74a-d12908ba4516 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:04 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab430997-f767-408e-9f81-134e3cd7aeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1a960e5-c08c-4efa-bb98-21a7de4345f1', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:04 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fb69db0-b315-4e12-a74a-d12908ba4516 1073741824 Sep 28 17:29:04 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28424932-9b97-4816-8fda-7fcc3577255a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e277df88-049b-433e-aeea-19f803c096f6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cbb9925c-0a22-41ea-9f8d-8380484ce294" returned: 0 in 0.269s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e277df88-049b-433e-aeea-19f803c096f6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-quobyte-cbb9925c-0a22-41ea-9f8d-8380484ce294" released by "delete_volume" :: held 0.788s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:04 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Volume volume-f1a960e5-c08c-4efa-bb98-21a7de4345f1 (f1a960e5-c08c-4efa-bb98-21a7de4345f1): created successfully Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28424932-9b97-4816-8fda-7fcc3577255a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Flow 'volume_create_manager' (99859305-5657-457e-a225-28181d0b5b5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:04 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-5f1e7b66-d0e3-4389-9197-7b69c7db8ba2 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Created volume successfully. Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-e277df88-049b-433e-aeea-19f803c096f6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Created reservations ['0e541f44-aaed-4026-8e90-beeeb012d90e', '66b68595-2779-4870-adae-37940eabd051', '5e627a78-1b82-4c66-abdc-aa52f5d03b49', 'a1ce1f00-e25f-49e2-8a81-60454127af1a'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e277df88-049b-433e-aeea-19f803c096f6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e277df88-049b-433e-aeea-19f803c096f6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e277df88-049b-433e-aeea-19f803c096f6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e277df88-049b-433e-aeea-19f803c096f6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e277df88-049b-433e-aeea-19f803c096f6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e277df88-049b-433e-aeea-19f803c096f6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:04 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:04 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d25b65eb-11e4-4fe3-a4a5-9ce6992a1992 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "cinder-b2483e09-4c8c-47e7-86d6-05d4c41eee50-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d25b65eb-11e4-4fe3-a4a5-9ce6992a1992 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-b2483e09-4c8c-47e7-86d6-05d4c41eee50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d25b65eb-11e4-4fe3-a4a5-9ce6992a1992 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "cinder-quobyte-5379e968-ad3c-4404-a6a9-c1a2a2312415" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d25b65eb-11e4-4fe3-a4a5-9ce6992a1992 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-quobyte-5379e968-ad3c-4404-a6a9-c1a2a2312415" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d25b65eb-11e4-4fe3-a4a5-9ce6992a1992 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "cinder-quobyte-b2483e09-4c8c-47e7-86d6-05d4c41eee50" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d25b65eb-11e4-4fe3-a4a5-9ce6992a1992 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-quobyte-b2483e09-4c8c-47e7-86d6-05d4c41eee50" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-d25b65eb-11e4-4fe3-a4a5-9ce6992a1992 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Deleting offline snapshot b2483e09-4c8c-47e7-86d6-05d4c41eee50 of volume 5379e968-ad3c-4404-a6a9-c1a2a2312415 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-d25b65eb-11e4-4fe3-a4a5-9ce6992a1992 tempest-CreateVolumesFromSnapshotTest-1297301981 None] snapshot_file for this snap is: volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.b2483e09-4c8c-47e7-86d6-05d4c41eee50 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[11032e9d-6836-46dd-8013-a4087af166df]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d25b65eb-11e4-4fe3-a4a5-9ce6992a1992 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.b2483e09-4c8c-47e7-86d6-05d4c41eee50 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:04 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.b2483e09-4c8c-47e7-86d6-05d4c41eee50 Sep 28 17:29:04 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:04 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e277df88-049b-433e-aeea-19f803c096f6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.327s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:04 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-e277df88-049b-433e-aeea-19f803c096f6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:04 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e277df88-049b-433e-aeea-19f803c096f6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Deleted volume successfully. Sep 28 17:29:05 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fb69db0-b315-4e12-a74a-d12908ba4516 1073741824" returned: 0 in 0.581s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-e277df88-049b-433e-aeea-19f803c096f6 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-cbb9925c-0a22-41ea-9f8d-8380484ce294-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fb69db0-b315-4e12-a74a-d12908ba4516 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:05 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fb69db0-b315-4e12-a74a-d12908ba4516 Sep 28 17:29:05 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:05 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d25b65eb-11e4-4fe3-a4a5-9ce6992a1992 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.b2483e09-4c8c-47e7-86d6-05d4c41eee50" returned: 0 in 0.419s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-d25b65eb-11e4-4fe3-a4a5-9ce6992a1992 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5379e968-ad3c-4404-a6a9-c1a2a2312415(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[938d6c8a-2076-4c01-b3b3-8758ef9913cb]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d25b65eb-11e4-4fe3-a4a5-9ce6992a1992 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:05 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fb69db0-b315-4e12-a74a-d12908ba4516" returned: 0 in 0.268s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.829s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ec4276-1188-4091-9680-41bef0aa6503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616653217dac42328919ce305f6b8784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:59Z,use_quota=True,user_id='8ba16714d7924f6495b29fac966d2d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Creating volume e0ec4276-1188-4091-9680-41bef0aa6503 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:05 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e0ec4276-1188-4091-9680-41bef0aa6503 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17234b74-297b-46df-83d7-7b4d3e9e6391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fb69db0-b315-4e12-a74a-d12908ba4516', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:05 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e0ec4276-1188-4091-9680-41bef0aa6503 1073741824 Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87f041a-2b2f-4953-920a-60282dec7e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:05 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:05 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Volume volume-3fb69db0-b315-4e12-a74a-d12908ba4516 (3fb69db0-b315-4e12-a74a-d12908ba4516): created successfully Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87f041a-2b2f-4953-920a-60282dec7e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Flow 'volume_create_manager' (1e41796c-9ef0-421b-b06d-6100ccd20b4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:05 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415 Sep 28 17:29:05 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:05 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-6eac5415-607b-4473-b78d-7f7b7aec1b4a tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Created volume successfully. Sep 28 17:29:05 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d25b65eb-11e4-4fe3-a4a5-9ce6992a1992 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415" returned: 0 in 0.444s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d25b65eb-11e4-4fe3-a4a5-9ce6992a1992 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.b2483e09-4c8c-47e7-86d6-05d4c41eee50 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:05 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.b2483e09-4c8c-47e7-86d6-05d4c41eee50 Sep 28 17:29:05 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:05 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e0ec4276-1188-4091-9680-41bef0aa6503 1073741824" returned: 0 in 0.474s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e0ec4276-1188-4091-9680-41bef0aa6503 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:05 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e0ec4276-1188-4091-9680-41bef0aa6503 Sep 28 17:29:05 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:06 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d25b65eb-11e4-4fe3-a4a5-9ce6992a1992 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.b2483e09-4c8c-47e7-86d6-05d4c41eee50" returned: 0 in 0.395s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d25b65eb-11e4-4fe3-a4a5-9ce6992a1992 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.b2483e09-4c8c-47e7-86d6-05d4c41eee50 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:06 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e0ec4276-1188-4091-9680-41bef0aa6503" returned: 0 in 0.277s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8a194214-4d0b-42c0-a01c-3a820e3168e4 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.452s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:06 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.b2483e09-4c8c-47e7-86d6-05d4c41eee50 Sep 28 17:29:06 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-8a194214-4d0b-42c0-a01c-3a820e3168e4 tempest-ProjectMemberTests-584998297 None] Creating offline snapshot 8529be4f-d180-4c97-931d-2d945b74778e of volume 7b066f10-7039-409c-ba03-7f69af0fbfa9 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Attempting download of f9e65718-3957-420a-a03f-93ceb13e9169 ((None, [{'url': 'file:///opt/stack/data/glance/images/f9e65718-3957-420a-a03f-93ceb13e9169', 'metadata': {}}])) to volume e0ec4276-1188-4091-9680-41bef0aa6503. {{(pid=87061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[370cd8ad-1aa4-4581-9c62-9b1adf58735c]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8a194214-4d0b-42c0-a01c-3a820e3168e4 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[6596236e-a6a0-478f-8577-3aa0534830e3]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9e65718-3957-420a-a03f-93ceb13e9169_569847k4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:06 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9 Sep 28 17:29:06 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:06 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9e65718-3957-420a-a03f-93ceb13e9169_569847k4 Sep 28 17:29:06 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:06 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d25b65eb-11e4-4fe3-a4a5-9ce6992a1992 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415.b2483e09-4c8c-47e7-86d6-05d4c41eee50" returned: 0 in 0.266s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d25b65eb-11e4-4fe3-a4a5-9ce6992a1992 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-quobyte-b2483e09-4c8c-47e7-86d6-05d4c41eee50" released by "_delete_snapshot" :: held 1.662s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d25b65eb-11e4-4fe3-a4a5-9ce6992a1992 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-quobyte-5379e968-ad3c-4404-a6a9-c1a2a2312415" released by "delete_snapshot" :: held 1.693s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-d25b65eb-11e4-4fe3-a4a5-9ce6992a1992 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Created reservations ['feadafd3-1d96-4629-baf9-2ba09d16aeec', '1959656b-b471-423a-983b-1abb81473372', '05efd3ab-bb91-478c-9d2b-3db95e26d827', '5b8504b4-5c51-4a24-8b05-e169cd921b2a'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:06 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d25b65eb-11e4-4fe3-a4a5-9ce6992a1992 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Delete snapshot completed successfully. Sep 28 17:29:06 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d25b65eb-11e4-4fe3-a4a5-9ce6992a1992 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-b2483e09-4c8c-47e7-86d6-05d4c41eee50-delete_snapshot" released by "delete_snapshot" :: held 1.889s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8a194214-4d0b-42c0-a01c-3a820e3168e4 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9" returned: 0 in 0.445s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8a194214-4d0b-42c0-a01c-3a820e3168e4 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.8529be4f-d180-4c97-931d-2d945b74778e 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:06 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9e65718-3957-420a-a03f-93ceb13e9169_569847k4" returned: 0 in 0.411s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9e65718-3957-420a-a03f-93ceb13e9169_569847k4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:06 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.8529be4f-d180-4c97-931d-2d945b74778e 1G Sep 28 17:29:06 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:06 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9e65718-3957-420a-a03f-93ceb13e9169_569847k4 Sep 28 17:29:06 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:06 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:06 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bc50bebd-ad8b-462e-ba92-dd7caba38994 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "cinder-5379e968-ad3c-4404-a6a9-c1a2a2312415-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bc50bebd-ad8b-462e-ba92-dd7caba38994 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-5379e968-ad3c-4404-a6a9-c1a2a2312415-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bc50bebd-ad8b-462e-ba92-dd7caba38994 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "cinder-quobyte-5379e968-ad3c-4404-a6a9-c1a2a2312415" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bc50bebd-ad8b-462e-ba92-dd7caba38994 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-quobyte-5379e968-ad3c-4404-a6a9-c1a2a2312415" acquired by "delete_volume" :: waited 0.021s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:07 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9e65718-3957-420a-a03f-93ceb13e9169_569847k4" returned: 1 in 0.437s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9e65718-3957-420a-a03f-93ceb13e9169_569847k4' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0bb9f3-7709-45c5-bd80-02412411368f]: (4, 'raw') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea63bee6-4940-4c98-b9ac-e5b57a95ed66]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bc50bebd-ad8b-462e-ba92-dd7caba38994 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:07 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:07 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8a194214-4d0b-42c0-a01c-3a820e3168e4 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.8529be4f-d180-4c97-931d-2d945b74778e 1G" returned: 0 in 0.591s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.402s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8a194214-4d0b-42c0-a01c-3a820e3168e4 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b066f10-7039-409c-ba03-7f69af0fbfa9 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.8529be4f-d180-4c97-931d-2d945b74778e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:07 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD Sep 28 17:29:07 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:07 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415 Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:29:07 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:29:07 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b066f10-7039-409c-ba03-7f69af0fbfa9 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.8529be4f-d180-4c97-931d-2d945b74778e Sep 28 17:29:07 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:07 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD" returned: 0 in 0.410s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:07 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bc50bebd-ad8b-462e-ba92-dd7caba38994 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415" returned: 0 in 0.453s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bc50bebd-ad8b-462e-ba92-dd7caba38994 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:07 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415 Sep 28 17:29:07 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:07 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD Sep 28 17:29:07 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:07 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8a194214-4d0b-42c0-a01c-3a820e3168e4 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b066f10-7039-409c-ba03-7f69af0fbfa9 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.8529be4f-d180-4c97-931d-2d945b74778e" returned: 0 in 0.419s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:07 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-8a194214-4d0b-42c0-a01c-3a820e3168e4 tempest-ProjectMemberTests-584998297 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.8529be4f-d180-4c97-931d-2d945b74778e is being set with open permissions: ugo+rw Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8a194214-4d0b-42c0-a01c-3a820e3168e4 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.8529be4f-d180-4c97-931d-2d945b74778e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:07 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.8529be4f-d180-4c97-931d-2d945b74778e Sep 28 17:29:07 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:07 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bc50bebd-ad8b-462e-ba92-dd7caba38994 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-5379e968-ad3c-4404-a6a9-c1a2a2312415" returned: 0 in 0.271s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bc50bebd-ad8b-462e-ba92-dd7caba38994 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-quobyte-5379e968-ad3c-4404-a6a9-c1a2a2312415" released by "delete_volume" :: held 0.825s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:07 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD" returned: 1 in 0.379s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD' failed. Not Retrying. {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] f9e65718-3957-420a-a03f-93ceb13e9169 was raw, converting to qcow2 {{(pid=87061) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e0ec4276-1188-4091-9680-41bef0aa6503 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:07 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e0ec4276-1188-4091-9680-41bef0aa6503 Sep 28 17:29:07 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-bc50bebd-ad8b-462e-ba92-dd7caba38994 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Created reservations ['8f0b9818-96e9-4bf5-9398-f020e83fbca1', '4cafccce-b1e6-4b19-8242-6373cd695504', '20dded69-189b-47fb-a0dc-0ccb3f075c97', '7c8e932b-997a-4f57-b1d8-229b60b408c0'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:07 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8a194214-4d0b-42c0-a01c-3a820e3168e4 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.8529be4f-d180-4c97-931d-2d945b74778e" returned: 0 in 0.323s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8a194214-4d0b-42c0-a01c-3a820e3168e4 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:08 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.info Sep 28 17:29:08 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-bc50bebd-ad8b-462e-ba92-dd7caba38994 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-bc50bebd-ad8b-462e-ba92-dd7caba38994 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-bc50bebd-ad8b-462e-ba92-dd7caba38994 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-bc50bebd-ad8b-462e-ba92-dd7caba38994 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-bc50bebd-ad8b-462e-ba92-dd7caba38994 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bc50bebd-ad8b-462e-ba92-dd7caba38994 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:08 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:08 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:08 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8a194214-4d0b-42c0-a01c-3a820e3168e4 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.info" returned: 0 in 0.319s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:08 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-8a194214-4d0b-42c0-a01c-3a820e3168e4 tempest-ProjectMemberTests-584998297 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.info is being set with open permissions: ugo+rw Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8a194214-4d0b-42c0-a01c-3a820e3168e4 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:08 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.info Sep 28 17:29:08 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:08 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bc50bebd-ad8b-462e-ba92-dd7caba38994 tempest-CreateVolumesFromSnapshotTest-1297301981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.333s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-bc50bebd-ad8b-462e-ba92-dd7caba38994 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:08 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-bc50bebd-ad8b-462e-ba92-dd7caba38994 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Deleted volume successfully. Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bc50bebd-ad8b-462e-ba92-dd7caba38994 tempest-CreateVolumesFromSnapshotTest-1297301981 None] Lock "cinder-5379e968-ad3c-4404-a6a9-c1a2a2312415-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:08 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e0ec4276-1188-4091-9680-41bef0aa6503" returned: 0 in 0.628s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f9e65718-3957-420a-a03f-93ceb13e9169_bck8ei34devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e0ec4276-1188-4091-9680-41bef0aa6503 {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:29:08 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e0ec4276-1188-4091-9680-41bef0aa6503 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:08 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e0ec4276-1188-4091-9680-41bef0aa6503 1G Sep 28 17:29:08 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:08 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8a194214-4d0b-42c0-a01c-3a820e3168e4 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.info" returned: 0 in 0.368s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8a194214-4d0b-42c0-a01c-3a820e3168e4 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.583s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.884s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2021859210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e1ddc5a-9822-4d25-80ff-88623abafac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22cab4e6ac194c4c8ff4c85727aacb85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:03Z,use_quota=True,user_id='451a3d2ed2fc4a36afd0a50d496d0fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Creating volume 6e1ddc5a-9822-4d25-80ff-88623abafac9 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:08 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6e1ddc5a-9822-4d25-80ff-88623abafac9 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:08 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6e1ddc5a-9822-4d25-80ff-88623abafac9 1073741824 Sep 28 17:29:08 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:08 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-8a194214-4d0b-42c0-a01c-3a820e3168e4 tempest-ProjectMemberTests-584998297 None] Create snapshot completed successfully Sep 28 17:29:08 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e0ec4276-1188-4091-9680-41bef0aa6503 1G" returned: 0 in 0.437s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Downloaded image f9e65718-3957-420a-a03f-93ceb13e9169 ((None, [{'url': 'file:///opt/stack/data/glance/images/f9e65718-3957-420a-a03f-93ceb13e9169', 'metadata': {}}])) to volume e0ec4276-1188-4091-9680-41bef0aa6503 successfully. {{(pid=87061) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Temporary image f9e65718-3957-420a-a03f-93ceb13e9169 for user 8ba16714d7924f6495b29fac966d2d3b is deleted. {{(pid=87061) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG cinder.volume.volume_utils [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Marking volume e0ec4276-1188-4091-9680-41bef0aa6503 as bootable. {{(pid=87061) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Copying metadata from image f9e65718-3957-420a-a03f-93ceb13e9169 to e0ec4276-1188-4091-9680-41bef0aa6503. {{(pid=87061) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:29:08 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Creating volume glance metadata for volume e0ec4276-1188-4091-9680-41bef0aa6503 backed by image f9e65718-3957-420a-a03f-93ceb13e9169 with: {'image_id': 'f9e65718-3957-420a-a03f-93ceb13e9169', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e0e4a6e8b85000a6de50668540d15903', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87061) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748d4571-c7e8-4671-bb49-1354e8d5be84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0ec4276-1188-4091-9680-41bef0aa6503', 'volume_size': 1, 'image_id': 'f9e65718-3957-420a-a03f-93ceb13e9169', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9e65718-3957-420a-a03f-93ceb13e9169', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e0e4a6e8b85000a6de50668540d15903', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '616653217dac42328919ce305f6b8784', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c3df3df56f3b9d46cb013ffb4a8a59458ee0a913158dff38359c6b5abd012e1c05ad0933613993f96cbc3fa220d4b1374c25a637d663802aca036d6a7b52f1bd', 'id': 'f9e65718-3957-420a-a03f-93ceb13e9169', 'created_at': datetime.datetime(2026, 9, 28, 15, 28, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 28, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9e65718-3957-420a-a03f-93ceb13e9169/file', 'properties': {}}, 'image_service': }' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd029ff9-528d-48a5-9e88-6d221c5c32c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:09 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Volume volume-e0ec4276-1188-4091-9680-41bef0aa6503 (e0ec4276-1188-4091-9680-41bef0aa6503): created successfully Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd029ff9-528d-48a5-9e88-6d221c5c32c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Flow 'volume_create_manager' (4b622946-3205-4fed-9ca0-8dc54ee35320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:09 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-1c5e4627-aaa0-4a3d-9eda-15984db5dd9b tempest-VolumeImageDependencyTests-1789281573 None] Created volume successfully. Sep 28 17:29:09 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6e1ddc5a-9822-4d25-80ff-88623abafac9 1073741824" returned: 0 in 0.664s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6e1ddc5a-9822-4d25-80ff-88623abafac9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:09 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6e1ddc5a-9822-4d25-80ff-88623abafac9 Sep 28 17:29:09 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:09 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6e1ddc5a-9822-4d25-80ff-88623abafac9" returned: 0 in 0.289s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1fa744-fe82-4050-9f16-21f71c627bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e1ddc5a-9822-4d25-80ff-88623abafac9', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881a71a1-d6ad-44d7-b142-686a54f3516f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f5bee3a3-127c-4073-a044-f88e22267aa6 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-8529be4f-d180-4c97-931d-2d945b74778e-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:09 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Volume volume-6e1ddc5a-9822-4d25-80ff-88623abafac9 (6e1ddc5a-9822-4d25-80ff-88623abafac9): created successfully Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881a71a1-d6ad-44d7-b142-686a54f3516f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Flow 'volume_create_manager' (f656d63a-debc-4ed7-8dcc-a07f8f2ee0be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f5bee3a3-127c-4073-a044-f88e22267aa6 tempest-ProjectMemberTests-584998297 None] Lock "cinder-8529be4f-d180-4c97-931d-2d945b74778e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f5bee3a3-127c-4073-a044-f88e22267aa6 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-7b066f10-7039-409c-ba03-7f69af0fbfa9" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:09 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-ccba66b1-3b89-4af8-9b46-5d5126359d1e tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Created volume successfully. Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f5bee3a3-127c-4073-a044-f88e22267aa6 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-7b066f10-7039-409c-ba03-7f69af0fbfa9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f5bee3a3-127c-4073-a044-f88e22267aa6 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-8529be4f-d180-4c97-931d-2d945b74778e" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f5bee3a3-127c-4073-a044-f88e22267aa6 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-8529be4f-d180-4c97-931d-2d945b74778e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-f5bee3a3-127c-4073-a044-f88e22267aa6 tempest-ProjectMemberTests-584998297 None] Deleting offline snapshot 8529be4f-d180-4c97-931d-2d945b74778e of volume 7b066f10-7039-409c-ba03-7f69af0fbfa9 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-f5bee3a3-127c-4073-a044-f88e22267aa6 tempest-ProjectMemberTests-584998297 None] snapshot_file for this snap is: volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.8529be4f-d180-4c97-931d-2d945b74778e {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd2d146-b113-4020-bd06-dff59f3a5ae0]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f5bee3a3-127c-4073-a044-f88e22267aa6 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.8529be4f-d180-4c97-931d-2d945b74778e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:10 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.8529be4f-d180-4c97-931d-2d945b74778e Sep 28 17:29:10 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3bc1687a-31ca-47f9-99d8-5395aa78123b tempest-VolumeImageDependencyTests-1789281573 None] Acquiring lock "cinder-e0ec4276-1188-4091-9680-41bef0aa6503-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3bc1687a-31ca-47f9-99d8-5395aa78123b tempest-VolumeImageDependencyTests-1789281573 None] Lock "cinder-e0ec4276-1188-4091-9680-41bef0aa6503-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3bc1687a-31ca-47f9-99d8-5395aa78123b tempest-VolumeImageDependencyTests-1789281573 None] Acquiring lock "cinder-quobyte-e0ec4276-1188-4091-9680-41bef0aa6503" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3bc1687a-31ca-47f9-99d8-5395aa78123b tempest-VolumeImageDependencyTests-1789281573 None] Lock "cinder-quobyte-e0ec4276-1188-4091-9680-41bef0aa6503" acquired by "delete_volume" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:10 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac8e8f4-bfad-4e5c-9cea-3bb2bdac121b]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3bc1687a-31ca-47f9-99d8-5395aa78123b tempest-VolumeImageDependencyTests-1789281573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e0ec4276-1188-4091-9680-41bef0aa6503 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:10 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e0ec4276-1188-4091-9680-41bef0aa6503 Sep 28 17:29:10 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:10 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-22a99754-0101-485f-846e-be5cf7fe6d79 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "cinder-6e1ddc5a-9822-4d25-80ff-88623abafac9-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f5bee3a3-127c-4073-a044-f88e22267aa6 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.8529be4f-d180-4c97-931d-2d945b74778e" returned: 0 in 0.558s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-f5bee3a3-127c-4073-a044-f88e22267aa6 tempest-ProjectMemberTests-584998297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b066f10-7039-409c-ba03-7f69af0fbfa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:29:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-22a99754-0101-485f-846e-be5cf7fe6d79 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-6e1ddc5a-9822-4d25-80ff-88623abafac9-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:10 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[887fdfe5-a40f-418c-8f98-d35811582cab]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f5bee3a3-127c-4073-a044-f88e22267aa6 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-22a99754-0101-485f-846e-be5cf7fe6d79 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "cinder-quobyte-6e1ddc5a-9822-4d25-80ff-88623abafac9" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:10 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-22a99754-0101-485f-846e-be5cf7fe6d79 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-quobyte-6e1ddc5a-9822-4d25-80ff-88623abafac9" acquired by "delete_volume" :: waited 0.025s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:10 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00a3b4a-7530-4fa1-b32a-e24f63fd0ab3]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-22a99754-0101-485f-846e-be5cf7fe6d79 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6e1ddc5a-9822-4d25-80ff-88623abafac9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:10 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9 Sep 28 17:29:10 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:10 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3bc1687a-31ca-47f9-99d8-5395aa78123b tempest-VolumeImageDependencyTests-1789281573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e0ec4276-1188-4091-9680-41bef0aa6503" returned: 0 in 0.484s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3bc1687a-31ca-47f9-99d8-5395aa78123b tempest-VolumeImageDependencyTests-1789281573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e0ec4276-1188-4091-9680-41bef0aa6503 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:10 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e0ec4276-1188-4091-9680-41bef0aa6503 Sep 28 17:29:10 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6e1ddc5a-9822-4d25-80ff-88623abafac9 Sep 28 17:29:10 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:10 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:11 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f5bee3a3-127c-4073-a044-f88e22267aa6 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9" returned: 0 in 0.591s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f5bee3a3-127c-4073-a044-f88e22267aa6 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.8529be4f-d180-4c97-931d-2d945b74778e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:11 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3bc1687a-31ca-47f9-99d8-5395aa78123b tempest-VolumeImageDependencyTests-1789281573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-e0ec4276-1188-4091-9680-41bef0aa6503" returned: 0 in 0.352s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:11 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.8529be4f-d180-4c97-931d-2d945b74778e Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3bc1687a-31ca-47f9-99d8-5395aa78123b tempest-VolumeImageDependencyTests-1789281573 None] Lock "cinder-quobyte-e0ec4276-1188-4091-9680-41bef0aa6503" released by "delete_volume" :: held 0.901s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:11 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:11 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-22a99754-0101-485f-846e-be5cf7fe6d79 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6e1ddc5a-9822-4d25-80ff-88623abafac9" returned: 0 in 0.506s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-22a99754-0101-485f-846e-be5cf7fe6d79 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6e1ddc5a-9822-4d25-80ff-88623abafac9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:11 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6e1ddc5a-9822-4d25-80ff-88623abafac9 Sep 28 17:29:11 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-3bc1687a-31ca-47f9-99d8-5395aa78123b tempest-VolumeImageDependencyTests-1789281573 None] Created reservations ['55209994-194a-4be9-b007-33696c43b580', '1ad9d4cf-6cac-423e-8c0a-7ac68ee41d10', '59a6f92a-e34c-4fa5-aa6e-310d7e29605b', 'e15f0810-39df-4028-9195-6a1058de2957'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3bc1687a-31ca-47f9-99d8-5395aa78123b tempest-VolumeImageDependencyTests-1789281573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3bc1687a-31ca-47f9-99d8-5395aa78123b tempest-VolumeImageDependencyTests-1789281573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3bc1687a-31ca-47f9-99d8-5395aa78123b tempest-VolumeImageDependencyTests-1789281573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3bc1687a-31ca-47f9-99d8-5395aa78123b tempest-VolumeImageDependencyTests-1789281573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3bc1687a-31ca-47f9-99d8-5395aa78123b tempest-VolumeImageDependencyTests-1789281573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3bc1687a-31ca-47f9-99d8-5395aa78123b tempest-VolumeImageDependencyTests-1789281573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:11 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:11 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:11 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-22a99754-0101-485f-846e-be5cf7fe6d79 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6e1ddc5a-9822-4d25-80ff-88623abafac9" returned: 0 in 0.379s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:11 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-22a99754-0101-485f-846e-be5cf7fe6d79 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-quobyte-6e1ddc5a-9822-4d25-80ff-88623abafac9" released by "delete_volume" :: held 0.970s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f5bee3a3-127c-4073-a044-f88e22267aa6 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.8529be4f-d180-4c97-931d-2d945b74778e" returned: 0 in 0.471s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f5bee3a3-127c-4073-a044-f88e22267aa6 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.8529be4f-d180-4c97-931d-2d945b74778e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:11 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.8529be4f-d180-4c97-931d-2d945b74778e Sep 28 17:29:11 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-22a99754-0101-485f-846e-be5cf7fe6d79 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Created reservations ['d98fd960-f96e-49e2-a073-43bcc8b835fe', 'f7534f89-4167-47bf-87f6-82c839164f7d', 'e3400b25-2b1c-4d9c-b4a5-56de4511d515', '5e37efe5-6cbe-40b0-a65e-8239f36edb99'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:11 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3bc1687a-31ca-47f9-99d8-5395aa78123b tempest-VolumeImageDependencyTests-1789281573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.311s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-3bc1687a-31ca-47f9-99d8-5395aa78123b tempest-VolumeImageDependencyTests-1789281573 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:11 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-3bc1687a-31ca-47f9-99d8-5395aa78123b tempest-VolumeImageDependencyTests-1789281573 None] Deleted volume successfully. Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-3bc1687a-31ca-47f9-99d8-5395aa78123b tempest-VolumeImageDependencyTests-1789281573 None] Lock "cinder-e0ec4276-1188-4091-9680-41bef0aa6503-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-22a99754-0101-485f-846e-be5cf7fe6d79 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-22a99754-0101-485f-846e-be5cf7fe6d79 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-22a99754-0101-485f-846e-be5cf7fe6d79 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-22a99754-0101-485f-846e-be5cf7fe6d79 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-22a99754-0101-485f-846e-be5cf7fe6d79 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-22a99754-0101-485f-846e-be5cf7fe6d79 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:11 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:11 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:11 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f5bee3a3-127c-4073-a044-f88e22267aa6 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9.8529be4f-d180-4c97-931d-2d945b74778e" returned: 0 in 0.344s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f5bee3a3-127c-4073-a044-f88e22267aa6 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-8529be4f-d180-4c97-931d-2d945b74778e" released by "_delete_snapshot" :: held 2.156s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f5bee3a3-127c-4073-a044-f88e22267aa6 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-7b066f10-7039-409c-ba03-7f69af0fbfa9" released by "delete_snapshot" :: held 2.196s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-f5bee3a3-127c-4073-a044-f88e22267aa6 tempest-ProjectMemberTests-584998297 None] Created reservations ['88c3e1af-21de-4a47-8e5e-7de7df9ad83f', '6c163371-2c0b-4b65-a19b-3f7a2a78e8a9', '518b2917-1f8d-4adb-90e6-205e24b2d8bc', 'cb23f392-da56-44be-ac98-12ae071257db'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:12 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-22a99754-0101-485f-846e-be5cf7fe6d79 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.317s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-22a99754-0101-485f-846e-be5cf7fe6d79 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:12 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-22a99754-0101-485f-846e-be5cf7fe6d79 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Deleted volume successfully. Sep 28 17:29:12 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-f5bee3a3-127c-4073-a044-f88e22267aa6 tempest-ProjectMemberTests-584998297 None] Delete snapshot completed successfully. Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-f5bee3a3-127c-4073-a044-f88e22267aa6 tempest-ProjectMemberTests-584998297 None] Lock "cinder-8529be4f-d180-4c97-931d-2d945b74778e-delete_snapshot" released by "delete_snapshot" :: held 2.400s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-22a99754-0101-485f-846e-be5cf7fe6d79 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-6e1ddc5a-9822-4d25-80ff-88623abafac9-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Flow 'volume_create_manager' (869fe7f2-2e28-44e9-a8a6-25fea9dfd433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e932d9-4cb5-465b-86bd-2bc7681e539c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e932d9-4cb5-465b-86bd-2bc7681e539c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce97c0db-62cc-4b05-97ea-1f058e75d88c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c7b7503ad64cdf8d295549e6a6f01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:12Z,use_quota=True,user_id='2c64a8f9868a49bb9e4fad66c85b0fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9671a0c9-0225-4bed-a3f4-e3448403fb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9671a0c9-0225-4bed-a3f4-e3448403fb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b03ffd-1650-40b2-8cd5-67a53beb58e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b03ffd-1650-40b2-8cd5-67a53beb58e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce97c0db-62cc-4b05-97ea-1f058e75d88c', 'volume_name': 'volume-ce97c0db-62cc-4b05-97ea-1f058e75d88c', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04f830a-c047-4865-8c4b-2bc754826e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04f830a-c047-4865-8c4b-2bc754826e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd03f510-fdeb-46e8-9149-81ff8f0a2ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:12 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Volume ce97c0db-62cc-4b05-97ea-1f058e75d88c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce97c0db-62cc-4b05-97ea-1f058e75d88c', 'volume_size': 1} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce97c0db-62cc-4b05-97ea-1f058e75d88c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c7b7503ad64cdf8d295549e6a6f01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:12Z,use_quota=True,user_id='2c64a8f9868a49bb9e4fad66c85b0fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Creating volume ce97c0db-62cc-4b05-97ea-1f058e75d88c {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:12 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce97c0db-62cc-4b05-97ea-1f058e75d88c 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:12 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce97c0db-62cc-4b05-97ea-1f058e75d88c 1073741824 Sep 28 17:29:12 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5df1f109-879a-4bc7-8597-9efc93043fa8 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "cinder-3fb69db0-b315-4e12-a74a-d12908ba4516-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5df1f109-879a-4bc7-8597-9efc93043fa8 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-3fb69db0-b315-4e12-a74a-d12908ba4516-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5df1f109-879a-4bc7-8597-9efc93043fa8 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "cinder-quobyte-3fb69db0-b315-4e12-a74a-d12908ba4516" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5df1f109-879a-4bc7-8597-9efc93043fa8 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-quobyte-3fb69db0-b315-4e12-a74a-d12908ba4516" acquired by "delete_volume" :: waited 0.027s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[288df721-5d5a-48c0-978d-c55caf1d342a]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5df1f109-879a-4bc7-8597-9efc93043fa8 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fb69db0-b315-4e12-a74a-d12908ba4516 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:12 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce97c0db-62cc-4b05-97ea-1f058e75d88c 1073741824" returned: 0 in 0.569s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce97c0db-62cc-4b05-97ea-1f058e75d88c {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:13 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce97c0db-62cc-4b05-97ea-1f058e75d88c Sep 28 17:29:13 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:13 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fb69db0-b315-4e12-a74a-d12908ba4516 Sep 28 17:29:13 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fc0e328f-0016-45c2-b411-5b94c3c11955 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-7b066f10-7039-409c-ba03-7f69af0fbfa9-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fc0e328f-0016-45c2-b411-5b94c3c11955 tempest-ProjectMemberTests-584998297 None] Lock "cinder-7b066f10-7039-409c-ba03-7f69af0fbfa9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fc0e328f-0016-45c2-b411-5b94c3c11955 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-7b066f10-7039-409c-ba03-7f69af0fbfa9" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fc0e328f-0016-45c2-b411-5b94c3c11955 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-7b066f10-7039-409c-ba03-7f69af0fbfa9" acquired by "delete_volume" :: waited 0.029s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:13 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5966e1ec-9091-48da-93bf-2048d2070cbc]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fc0e328f-0016-45c2-b411-5b94c3c11955 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:13 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5df1f109-879a-4bc7-8597-9efc93043fa8 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fb69db0-b315-4e12-a74a-d12908ba4516" returned: 0 in 0.502s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5df1f109-879a-4bc7-8597-9efc93043fa8 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fb69db0-b315-4e12-a74a-d12908ba4516 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:13 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9 Sep 28 17:29:13 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:13 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce97c0db-62cc-4b05-97ea-1f058e75d88c" returned: 0 in 0.451s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:13 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:13 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fb69db0-b315-4e12-a74a-d12908ba4516 Sep 28 17:29:13 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd03f510-fdeb-46e8-9149-81ff8f0a2ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce97c0db-62cc-4b05-97ea-1f058e75d88c', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ef212f-e486-47bf-88f8-c697ac244ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:13 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Volume volume-ce97c0db-62cc-4b05-97ea-1f058e75d88c (ce97c0db-62cc-4b05-97ea-1f058e75d88c): created successfully Sep 28 17:29:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ef212f-e486-47bf-88f8-c697ac244ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:13 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Flow 'volume_create_manager' (869fe7f2-2e28-44e9-a8a6-25fea9dfd433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:13 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-adb0de4a-8948-4c20-92e9-2c427579b1e5 tempest-CinderUnicodeTest-739438717 None] Created volume successfully. Sep 28 17:29:13 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5df1f109-879a-4bc7-8597-9efc93043fa8 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3fb69db0-b315-4e12-a74a-d12908ba4516" returned: 0 in 0.300s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5df1f109-879a-4bc7-8597-9efc93043fa8 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-quobyte-3fb69db0-b315-4e12-a74a-d12908ba4516" released by "delete_volume" :: held 0.874s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:13 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fc0e328f-0016-45c2-b411-5b94c3c11955 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9" returned: 0 in 0.478s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fc0e328f-0016-45c2-b411-5b94c3c11955 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:13 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9 Sep 28 17:29:13 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:13 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-5df1f109-879a-4bc7-8597-9efc93043fa8 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Created reservations ['c48131b1-0267-4c3c-98b0-dd7f3417f8ed', '2672ab98-9487-4db4-8733-394385b42098', '10c7a518-56c8-4477-9736-e39f39e7556b', '1b08a047-d519-41b8-8875-9d4cd4ebdb61'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5df1f109-879a-4bc7-8597-9efc93043fa8 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5df1f109-879a-4bc7-8597-9efc93043fa8 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:14 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-5df1f109-879a-4bc7-8597-9efc93043fa8 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:14 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-5df1f109-879a-4bc7-8597-9efc93043fa8 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5df1f109-879a-4bc7-8597-9efc93043fa8 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5df1f109-879a-4bc7-8597-9efc93043fa8 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:14 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:14 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:14 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fc0e328f-0016-45c2-b411-5b94c3c11955 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7b066f10-7039-409c-ba03-7f69af0fbfa9" returned: 0 in 0.411s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fc0e328f-0016-45c2-b411-5b94c3c11955 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-7b066f10-7039-409c-ba03-7f69af0fbfa9" released by "delete_volume" :: held 0.987s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:14 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-fc0e328f-0016-45c2-b411-5b94c3c11955 tempest-ProjectMemberTests-584998297 None] Created reservations ['b7d2f991-3824-47bf-8733-8c498efc6b5f', '94ecdb6a-e06e-426b-a874-651fdf483c15', '50749c9a-726b-489a-a06f-384743327497', '3f361376-c9e7-4e75-ab42-6bb3420fcb5f'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fc0e328f-0016-45c2-b411-5b94c3c11955 tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fc0e328f-0016-45c2-b411-5b94c3c11955 tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:14 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fc0e328f-0016-45c2-b411-5b94c3c11955 tempest-ProjectMemberTests-584998297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:14 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-fc0e328f-0016-45c2-b411-5b94c3c11955 tempest-ProjectMemberTests-584998297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-fc0e328f-0016-45c2-b411-5b94c3c11955 tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fc0e328f-0016-45c2-b411-5b94c3c11955 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:14 devstack sudo[108114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:14 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:14 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5df1f109-879a-4bc7-8597-9efc93043fa8 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.521s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:14 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-5df1f109-879a-4bc7-8597-9efc93043fa8 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:14 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-5df1f109-879a-4bc7-8597-9efc93043fa8 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Deleted volume successfully. Sep 28 17:29:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5df1f109-879a-4bc7-8597-9efc93043fa8 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-3fb69db0-b315-4e12-a74a-d12908ba4516-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:14 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-fc0e328f-0016-45c2-b411-5b94c3c11955 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.399s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:14 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-fc0e328f-0016-45c2-b411-5b94c3c11955 tempest-ProjectMemberTests-584998297 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:14 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-fc0e328f-0016-45c2-b411-5b94c3c11955 tempest-ProjectMemberTests-584998297 None] Deleted volume successfully. Sep 28 17:29:14 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-fc0e328f-0016-45c2-b411-5b94c3c11955 tempest-ProjectMemberTests-584998297 None] Lock "cinder-7b066f10-7039-409c-ba03-7f69af0fbfa9-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-029a3a37-48eb-467a-8355-f05ae9114a7f tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "cinder-f1a960e5-c08c-4efa-bb98-21a7de4345f1-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-029a3a37-48eb-467a-8355-f05ae9114a7f tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-f1a960e5-c08c-4efa-bb98-21a7de4345f1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-029a3a37-48eb-467a-8355-f05ae9114a7f tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "cinder-quobyte-f1a960e5-c08c-4efa-bb98-21a7de4345f1" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-029a3a37-48eb-467a-8355-f05ae9114a7f tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-quobyte-f1a960e5-c08c-4efa-bb98-21a7de4345f1" acquired by "delete_volume" :: waited 0.028s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[3934c7c3-80d6-4408-a3fd-f4515ea24b31]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-029a3a37-48eb-467a-8355-f05ae9114a7f tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f1a960e5-c08c-4efa-bb98-21a7de4345f1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Flow 'volume_create_manager' (a562d76f-4074-4a21-8fde-265cca2b9d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592c99c8-ba49-48bc-8e8b-c41d6ddfe6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592c99c8-ba49-48bc-8e8b-c41d6ddfe6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1081422213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f21a8a-09a3-442d-b7cf-5c8cedb0fe98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c7b7503ad64cdf8d295549e6a6f01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:15Z,use_quota=True,user_id='2c64a8f9868a49bb9e4fad66c85b0fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68ea74a-dc90-4083-b733-dcbe66b529d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68ea74a-dc90-4083-b733-dcbe66b529d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89fe8b4b-99ed-4443-bfca-5f117991565b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89fe8b4b-99ed-4443-bfca-5f117991565b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31f21a8a-09a3-442d-b7cf-5c8cedb0fe98', 'volume_name': 'volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0448fd25-3cad-4e56-864b-9d836c2552bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0448fd25-3cad-4e56-864b-9d836c2552bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:15 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f1a960e5-c08c-4efa-bb98-21a7de4345f1 Sep 28 17:29:15 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56cf992c-75fb-4cb0-972c-dbec4f1ed874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:15 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Volume 31f21a8a-09a3-442d-b7cf-5c8cedb0fe98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98', 'volume_size': 1} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1081422213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f21a8a-09a3-442d-b7cf-5c8cedb0fe98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c7b7503ad64cdf8d295549e6a6f01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:15Z,use_quota=True,user_id='2c64a8f9868a49bb9e4fad66c85b0fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Creating volume 31f21a8a-09a3-442d-b7cf-5c8cedb0fe98 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:15 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:15 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98 1073741824 Sep 28 17:29:15 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:15 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-029a3a37-48eb-467a-8355-f05ae9114a7f tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f1a960e5-c08c-4efa-bb98-21a7de4345f1" returned: 0 in 0.449s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-029a3a37-48eb-467a-8355-f05ae9114a7f tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f1a960e5-c08c-4efa-bb98-21a7de4345f1 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:15 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f1a960e5-c08c-4efa-bb98-21a7de4345f1 Sep 28 17:29:15 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:16 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-029a3a37-48eb-467a-8355-f05ae9114a7f tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f1a960e5-c08c-4efa-bb98-21a7de4345f1" returned: 0 in 0.390s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:16 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98 1073741824" returned: 0 in 0.704s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-029a3a37-48eb-467a-8355-f05ae9114a7f tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-quobyte-f1a960e5-c08c-4efa-bb98-21a7de4345f1" released by "delete_volume" :: held 0.907s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:16 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98 Sep 28 17:29:16 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Flow 'volume_create_manager' (43c79759-302e-4c52-9bd6-ecbc5f6e3eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23781f1-eab5-4de9-9c39-4e5359fc23a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23781f1-eab5-4de9-9c39-4e5359fc23a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2101378736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fdaa334-2120-4285-83f8-5246e9d98e6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716b289f0179458f8e2e869e7ff71485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:16Z,use_quota=True,user_id='ccaca5bfad8b4b96b2ae3b66012f813b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd35f9d-67bd-4bc3-a314-5c35cb07f2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd35f9d-67bd-4bc3-a314-5c35cb07f2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00b8dfd7-3bd3-4909-84a9-9d93b56ba8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00b8dfd7-3bd3-4909-84a9-9d93b56ba8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fdaa334-2120-4285-83f8-5246e9d98e6e', 'volume_name': 'volume-6fdaa334-2120-4285-83f8-5246e9d98e6e', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89349251-c062-4a80-b150-9df3b94e26f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89349251-c062-4a80-b150-9df3b94e26f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d545696-fc40-42c5-a5d2-7da7fd88a8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:16 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Volume 6fdaa334-2120-4285-83f8-5246e9d98e6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fdaa334-2120-4285-83f8-5246e9d98e6e', 'volume_size': 1} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-029a3a37-48eb-467a-8355-f05ae9114a7f tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Created reservations ['a9f89a0a-8dbc-442b-90fd-13a1bfbc673d', 'bf49ce19-996e-44e9-927b-6f4df063ea54', '8895bb05-68c5-49b5-8b52-ef9f329fb7ce', 'c2b9dfd3-6947-4365-92ab-66640494fe7b'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-029a3a37-48eb-467a-8355-f05ae9114a7f tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-029a3a37-48eb-467a-8355-f05ae9114a7f tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-029a3a37-48eb-467a-8355-f05ae9114a7f tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-029a3a37-48eb-467a-8355-f05ae9114a7f tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-029a3a37-48eb-467a-8355-f05ae9114a7f tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-029a3a37-48eb-467a-8355-f05ae9114a7f tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:16 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:16 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:16 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98" returned: 0 in 0.332s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.190s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2101378736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fdaa334-2120-4285-83f8-5246e9d98e6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716b289f0179458f8e2e869e7ff71485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:16Z,use_quota=True,user_id='ccaca5bfad8b4b96b2ae3b66012f813b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Creating volume 6fdaa334-2120-4285-83f8-5246e9d98e6e {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:16 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:16 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e 1073741824 Sep 28 17:29:16 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56cf992c-75fb-4cb0-972c-dbec4f1ed874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4164b6-be1d-4457-b23f-f79e7c91ea1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:16 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Volume volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98 (31f21a8a-09a3-442d-b7cf-5c8cedb0fe98): created successfully Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4164b6-be1d-4457-b23f-f79e7c91ea1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Flow 'volume_create_manager' (a562d76f-4074-4a21-8fde-265cca2b9d38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:16 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-b77d8328-27ae-4f16-a5a6-740e7d509570 tempest-CinderUnicodeTest-739438717 None] Created volume successfully. Sep 28 17:29:16 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-029a3a37-48eb-467a-8355-f05ae9114a7f tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.339s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-029a3a37-48eb-467a-8355-f05ae9114a7f tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:16 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-029a3a37-48eb-467a-8355-f05ae9114a7f tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Deleted volume successfully. Sep 28 17:29:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-029a3a37-48eb-467a-8355-f05ae9114a7f tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-f1a960e5-c08c-4efa-bb98-21a7de4345f1-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:17 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e 1073741824" returned: 0 in 0.538s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:17 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e Sep 28 17:29:17 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6fdbfbfe-d8a2-4d67-9bdc-74b5b82e922e tempest-ProjectAdminTests-1786073354 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.12845993042, 'free_capacity_gb': 1775.12845993042, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87061) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 17:29:17 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e" returned: 0 in 0.313s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d545696-fc40-42c5-a5d2-7da7fd88a8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fdaa334-2120-4285-83f8-5246e9d98e6e', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e1828b-432b-4336-b8be-081fc46a8472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-226bd4bf-c142-4912-9ecb-1d4fd92c17f3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "cinder-8fdbac24-9762-47d5-a999-3efc16b927b5-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:17 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Volume volume-6fdaa334-2120-4285-83f8-5246e9d98e6e (6fdaa334-2120-4285-83f8-5246e9d98e6e): created successfully Sep 28 17:29:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e1828b-432b-4336-b8be-081fc46a8472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Flow 'volume_create_manager' (43c79759-302e-4c52-9bd6-ecbc5f6e3eba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-226bd4bf-c142-4912-9ecb-1d4fd92c17f3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-8fdbac24-9762-47d5-a999-3efc16b927b5-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:17 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-98c02e02-2ad6-4b26-9dff-4546914da149 tempest-ProjectMemberTests-584998297 None] Created volume successfully. Sep 28 17:29:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-226bd4bf-c142-4912-9ecb-1d4fd92c17f3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "cinder-quobyte-8fdbac24-9762-47d5-a999-3efc16b927b5" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-226bd4bf-c142-4912-9ecb-1d4fd92c17f3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-quobyte-8fdbac24-9762-47d5-a999-3efc16b927b5" acquired by "delete_volume" :: waited 0.019s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:17 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa464ef-44f5-4633-a9ac-4e88c1fe6c98]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-226bd4bf-c142-4912-9ecb-1d4fd92c17f3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8fdbac24-9762-47d5-a999-3efc16b927b5 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0f47f46a-d862-442f-8be3-9252c60e9da6 tempest-CinderUnicodeTest-739438717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0f47f46a-d862-442f-8be3-9252c60e9da6 tempest-CinderUnicodeTest-739438717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-0f47f46a-d862-442f-8be3-9252c60e9da6 tempest-CinderUnicodeTest-739438717 None] Creating offline snapshot cf53f0d5-4574-4f48-a22a-37bb566a22cb of volume 31f21a8a-09a3-442d-b7cf-5c8cedb0fe98 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:29:17 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2247f12-813c-4890-92c7-9129c25bb80e]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0f47f46a-d862-442f-8be3-9252c60e9da6 tempest-CinderUnicodeTest-739438717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:17 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8fdbac24-9762-47d5-a999-3efc16b927b5 Sep 28 17:29:17 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:17 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98 Sep 28 17:29:17 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:18 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-226bd4bf-c142-4912-9ecb-1d4fd92c17f3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8fdbac24-9762-47d5-a999-3efc16b927b5" returned: 0 in 0.510s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-226bd4bf-c142-4912-9ecb-1d4fd92c17f3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8fdbac24-9762-47d5-a999-3efc16b927b5 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:18 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8fdbac24-9762-47d5-a999-3efc16b927b5 Sep 28 17:29:18 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:18 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0f47f46a-d862-442f-8be3-9252c60e9da6 tempest-CinderUnicodeTest-739438717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98" returned: 0 in 0.490s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0f47f46a-d862-442f-8be3-9252c60e9da6 tempest-CinderUnicodeTest-739438717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.cf53f0d5-4574-4f48-a22a-37bb566a22cb 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:18 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.cf53f0d5-4574-4f48-a22a-37bb566a22cb 1G Sep 28 17:29:18 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:18 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-226bd4bf-c142-4912-9ecb-1d4fd92c17f3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-8fdbac24-9762-47d5-a999-3efc16b927b5" returned: 0 in 0.355s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e1732979-c95b-4488-998c-d0251062e278 tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-226bd4bf-c142-4912-9ecb-1d4fd92c17f3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-quobyte-8fdbac24-9762-47d5-a999-3efc16b927b5" released by "delete_volume" :: held 0.934s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:18 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-226bd4bf-c142-4912-9ecb-1d4fd92c17f3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Created reservations ['465b5bb4-82d3-47f3-8955-1118a296dd3b', '81ae466a-7b81-42fb-ae77-9fbd9c75f21b', 'e9e37d27-46b6-433b-8640-e8c7e316e3d2', '26fd509a-a81f-42ef-be3c-c2c0c34f57d9'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-226bd4bf-c142-4912-9ecb-1d4fd92c17f3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-226bd4bf-c142-4912-9ecb-1d4fd92c17f3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:18 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-226bd4bf-c142-4912-9ecb-1d4fd92c17f3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:18 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-226bd4bf-c142-4912-9ecb-1d4fd92c17f3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-226bd4bf-c142-4912-9ecb-1d4fd92c17f3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-226bd4bf-c142-4912-9ecb-1d4fd92c17f3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:18 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:18 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-978169c9-2a1a-4b30-a306-e25ec4377c68 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "cinder-6ca15f12-a1af-463a-878d-d448ffcf244d-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-978169c9-2a1a-4b30-a306-e25ec4377c68 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-6ca15f12-a1af-463a-878d-d448ffcf244d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-978169c9-2a1a-4b30-a306-e25ec4377c68 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "cinder-quobyte-6ca15f12-a1af-463a-878d-d448ffcf244d" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-978169c9-2a1a-4b30-a306-e25ec4377c68 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-quobyte-6ca15f12-a1af-463a-878d-d448ffcf244d" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:19 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0f47f46a-d862-442f-8be3-9252c60e9da6 tempest-CinderUnicodeTest-739438717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.cf53f0d5-4574-4f48-a22a-37bb566a22cb 1G" returned: 0 in 0.686s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0f47f46a-d862-442f-8be3-9252c60e9da6 tempest-CinderUnicodeTest-739438717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.cf53f0d5-4574-4f48-a22a-37bb566a22cb {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:19 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6025356-befd-4932-bd9f-1771b88ce7e9]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-978169c9-2a1a-4b30-a306-e25ec4377c68 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6ca15f12-a1af-463a-878d-d448ffcf244d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:19 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.cf53f0d5-4574-4f48-a22a-37bb566a22cb Sep 28 17:29:19 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:19 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-226bd4bf-c142-4912-9ecb-1d4fd92c17f3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.374s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:19 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-226bd4bf-c142-4912-9ecb-1d4fd92c17f3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:19 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-226bd4bf-c142-4912-9ecb-1d4fd92c17f3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Deleted volume successfully. Sep 28 17:29:19 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-226bd4bf-c142-4912-9ecb-1d4fd92c17f3 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-8fdbac24-9762-47d5-a999-3efc16b927b5-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:19 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6ca15f12-a1af-463a-878d-d448ffcf244d Sep 28 17:29:19 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:19 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0f47f46a-d862-442f-8be3-9252c60e9da6 tempest-CinderUnicodeTest-739438717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.cf53f0d5-4574-4f48-a22a-37bb566a22cb" returned: 0 in 0.412s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:19 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-0f47f46a-d862-442f-8be3-9252c60e9da6 tempest-CinderUnicodeTest-739438717 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.cf53f0d5-4574-4f48-a22a-37bb566a22cb is being set with open permissions: ugo+rw Sep 28 17:29:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0f47f46a-d862-442f-8be3-9252c60e9da6 tempest-CinderUnicodeTest-739438717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.cf53f0d5-4574-4f48-a22a-37bb566a22cb {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:19 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.cf53f0d5-4574-4f48-a22a-37bb566a22cb Sep 28 17:29:19 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:19 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-978169c9-2a1a-4b30-a306-e25ec4377c68 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6ca15f12-a1af-463a-878d-d448ffcf244d" returned: 0 in 0.453s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-978169c9-2a1a-4b30-a306-e25ec4377c68 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6ca15f12-a1af-463a-878d-d448ffcf244d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:19 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6ca15f12-a1af-463a-878d-d448ffcf244d Sep 28 17:29:19 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:19 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0f47f46a-d862-442f-8be3-9252c60e9da6 tempest-CinderUnicodeTest-739438717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.cf53f0d5-4574-4f48-a22a-37bb566a22cb" returned: 0 in 0.339s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0f47f46a-d862-442f-8be3-9252c60e9da6 tempest-CinderUnicodeTest-739438717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:19 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-978169c9-2a1a-4b30-a306-e25ec4377c68 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6ca15f12-a1af-463a-878d-d448ffcf244d" returned: 0 in 0.349s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:19 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.info Sep 28 17:29:19 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:19 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-978169c9-2a1a-4b30-a306-e25ec4377c68 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-quobyte-6ca15f12-a1af-463a-878d-d448ffcf244d" released by "delete_volume" :: held 0.888s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:19 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-978169c9-2a1a-4b30-a306-e25ec4377c68 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Created reservations ['160a2718-31b9-4bbb-abc1-97eaae9873ff', '4a33e0a3-8e24-48cf-830e-ac9bedcc4683', '2c96aa22-16cd-4fc7-a40f-2ae31f81ab69', '53c9a2ef-87b1-4365-ae07-251b8efd581f'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-978169c9-2a1a-4b30-a306-e25ec4377c68 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-978169c9-2a1a-4b30-a306-e25ec4377c68 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:20 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-978169c9-2a1a-4b30-a306-e25ec4377c68 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:20 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-978169c9-2a1a-4b30-a306-e25ec4377c68 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-978169c9-2a1a-4b30-a306-e25ec4377c68 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-978169c9-2a1a-4b30-a306-e25ec4377c68 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:20 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:20 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:20 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0f47f46a-d862-442f-8be3-9252c60e9da6 tempest-CinderUnicodeTest-739438717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.info" returned: 0 in 0.383s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:20 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-0f47f46a-d862-442f-8be3-9252c60e9da6 tempest-CinderUnicodeTest-739438717 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.info is being set with open permissions: ugo+rw Sep 28 17:29:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0f47f46a-d862-442f-8be3-9252c60e9da6 tempest-CinderUnicodeTest-739438717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:20 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.info Sep 28 17:29:20 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:20 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-978169c9-2a1a-4b30-a306-e25ec4377c68 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.312s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:20 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-978169c9-2a1a-4b30-a306-e25ec4377c68 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:20 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-978169c9-2a1a-4b30-a306-e25ec4377c68 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Deleted volume successfully. Sep 28 17:29:20 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-978169c9-2a1a-4b30-a306-e25ec4377c68 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-6ca15f12-a1af-463a-878d-d448ffcf244d-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:20 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0f47f46a-d862-442f-8be3-9252c60e9da6 tempest-CinderUnicodeTest-739438717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.info" returned: 0 in 0.307s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0f47f46a-d862-442f-8be3-9252c60e9da6 tempest-CinderUnicodeTest-739438717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.727s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e1732979-c95b-4488-998c-d0251062e278 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.959s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:20 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-e1732979-c95b-4488-998c-d0251062e278 tempest-ProjectMemberTests-584998297 None] Creating offline snapshot 8a182cba-9732-4b71-a28a-ad572195295c of volume 6fdaa334-2120-4285-83f8-5246e9d98e6e {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:29:20 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-0f47f46a-d862-442f-8be3-9252c60e9da6 tempest-CinderUnicodeTest-739438717 None] Create snapshot completed successfully Sep 28 17:29:20 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac05e36-c762-424e-867f-4feeb7a56ab5]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e1732979-c95b-4488-998c-d0251062e278 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:20 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e Sep 28 17:29:20 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:21 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e1732979-c95b-4488-998c-d0251062e278 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e" returned: 0 in 0.476s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e1732979-c95b-4488-998c-d0251062e278 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.8a182cba-9732-4b71-a28a-ad572195295c 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:21 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.8a182cba-9732-4b71-a28a-ad572195295c 1G Sep 28 17:29:21 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-522e0f41-f024-4136-86b5-d626661f36a8 tempest-CinderUnicodeTest-739438717 None] Acquiring lock "cinder-cf53f0d5-4574-4f48-a22a-37bb566a22cb-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-522e0f41-f024-4136-86b5-d626661f36a8 tempest-CinderUnicodeTest-739438717 None] Lock "cinder-cf53f0d5-4574-4f48-a22a-37bb566a22cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-522e0f41-f024-4136-86b5-d626661f36a8 tempest-CinderUnicodeTest-739438717 None] Acquiring lock "cinder-quobyte-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-18e909b7-d841-4994-b0b1-7e1792157b01 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "cinder-14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-522e0f41-f024-4136-86b5-d626661f36a8 tempest-CinderUnicodeTest-739438717 None] Lock "cinder-quobyte-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-522e0f41-f024-4136-86b5-d626661f36a8 tempest-CinderUnicodeTest-739438717 None] Acquiring lock "cinder-quobyte-cf53f0d5-4574-4f48-a22a-37bb566a22cb" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-18e909b7-d841-4994-b0b1-7e1792157b01 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-522e0f41-f024-4136-86b5-d626661f36a8 tempest-CinderUnicodeTest-739438717 None] Lock "cinder-quobyte-cf53f0d5-4574-4f48-a22a-37bb566a22cb" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-522e0f41-f024-4136-86b5-d626661f36a8 tempest-CinderUnicodeTest-739438717 None] Deleting offline snapshot cf53f0d5-4574-4f48-a22a-37bb566a22cb of volume 31f21a8a-09a3-442d-b7cf-5c8cedb0fe98 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-522e0f41-f024-4136-86b5-d626661f36a8 tempest-CinderUnicodeTest-739438717 None] snapshot_file for this snap is: volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.cf53f0d5-4574-4f48-a22a-37bb566a22cb {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a72cbc-7577-458f-8677-5a35771a1975]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-522e0f41-f024-4136-86b5-d626661f36a8 tempest-CinderUnicodeTest-739438717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.cf53f0d5-4574-4f48-a22a-37bb566a22cb {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-18e909b7-d841-4994-b0b1-7e1792157b01 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "cinder-quobyte-14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-18e909b7-d841-4994-b0b1-7e1792157b01 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-quobyte-14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2" acquired by "delete_volume" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[166a01e8-584f-458f-99bf-3c194ff0b46e]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-18e909b7-d841-4994-b0b1-7e1792157b01 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:21 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.cf53f0d5-4574-4f48-a22a-37bb566a22cb Sep 28 17:29:21 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:21 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2 Sep 28 17:29:21 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:21 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e1732979-c95b-4488-998c-d0251062e278 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.8a182cba-9732-4b71-a28a-ad572195295c 1G" returned: 0 in 0.694s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e1732979-c95b-4488-998c-d0251062e278 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fdaa334-2120-4285-83f8-5246e9d98e6e -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.8a182cba-9732-4b71-a28a-ad572195295c {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:21 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fdaa334-2120-4285-83f8-5246e9d98e6e -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.8a182cba-9732-4b71-a28a-ad572195295c Sep 28 17:29:21 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:21 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-522e0f41-f024-4136-86b5-d626661f36a8 tempest-CinderUnicodeTest-739438717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.cf53f0d5-4574-4f48-a22a-37bb566a22cb" returned: 0 in 0.512s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-522e0f41-f024-4136-86b5-d626661f36a8 tempest-CinderUnicodeTest-739438717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[579f5f3d-7518-4bda-b78c-44242bdabd3a]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-522e0f41-f024-4136-86b5-d626661f36a8 tempest-CinderUnicodeTest-739438717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:22 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-18e909b7-d841-4994-b0b1-7e1792157b01 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2" returned: 0 in 0.541s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-18e909b7-d841-4994-b0b1-7e1792157b01 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:22 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2 Sep 28 17:29:22 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:22 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98 Sep 28 17:29:22 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:22 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e1732979-c95b-4488-998c-d0251062e278 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fdaa334-2120-4285-83f8-5246e9d98e6e -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.8a182cba-9732-4b71-a28a-ad572195295c" returned: 0 in 0.441s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:22 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-e1732979-c95b-4488-998c-d0251062e278 tempest-ProjectMemberTests-584998297 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.8a182cba-9732-4b71-a28a-ad572195295c is being set with open permissions: ugo+rw Sep 28 17:29:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e1732979-c95b-4488-998c-d0251062e278 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.8a182cba-9732-4b71-a28a-ad572195295c {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:22 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.8a182cba-9732-4b71-a28a-ad572195295c Sep 28 17:29:22 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:22 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-18e909b7-d841-4994-b0b1-7e1792157b01 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2" returned: 0 in 0.317s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:22 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-18e909b7-d841-4994-b0b1-7e1792157b01 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-quobyte-14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2" released by "delete_volume" :: held 0.927s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:22 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-18e909b7-d841-4994-b0b1-7e1792157b01 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Created reservations ['5ec89a53-88ab-45bf-ac42-8851e7523979', '5702c647-8c56-44d5-bb53-b653407f275b', '5f16d638-5be6-4c4d-a49c-534e5f6535e9', 'b00ec361-9e85-4db3-93b4-250f4ecd87e5'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:22 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-522e0f41-f024-4136-86b5-d626661f36a8 tempest-CinderUnicodeTest-739438717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98" returned: 0 in 0.569s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-522e0f41-f024-4136-86b5-d626661f36a8 tempest-CinderUnicodeTest-739438717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.cf53f0d5-4574-4f48-a22a-37bb566a22cb {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:22 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.cf53f0d5-4574-4f48-a22a-37bb566a22cb Sep 28 17:29:22 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-18e909b7-d841-4994-b0b1-7e1792157b01 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-18e909b7-d841-4994-b0b1-7e1792157b01 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:22 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-18e909b7-d841-4994-b0b1-7e1792157b01 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:22 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-18e909b7-d841-4994-b0b1-7e1792157b01 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-18e909b7-d841-4994-b0b1-7e1792157b01 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-18e909b7-d841-4994-b0b1-7e1792157b01 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:22 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e1732979-c95b-4488-998c-d0251062e278 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.8a182cba-9732-4b71-a28a-ad572195295c" returned: 0 in 0.447s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:22 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:22 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e1732979-c95b-4488-998c-d0251062e278 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:22 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.info Sep 28 17:29:22 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:22 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Flow 'volume_create_manager' (d54cd95e-f4fa-4577-baae-9378dfce1878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a260d1-9f15-449b-88f9-7f38197ff8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a260d1-9f15-449b-88f9-7f38197ff8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-420186604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=573ecb4c-2ba2-480d-8bee-3547ec88ef11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b564bdb2eb4eb0b9aaea1656070df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:23Z,use_quota=True,user_id='2dcb04c77a78408694c61bd4576909f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:22 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffe7095-457c-4f56-a85c-63a0259b9d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffe7095-457c-4f56-a85c-63a0259b9d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:23 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:23 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef85b19-5344-4716-83fd-c111e46bfdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef85b19-5344-4716-83fd-c111e46bfdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '573ecb4c-2ba2-480d-8bee-3547ec88ef11', 'volume_name': 'volume-573ecb4c-2ba2-480d-8bee-3547ec88ef11', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b039ba-55fe-4d5b-91d0-0d15e84c403c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b039ba-55fe-4d5b-91d0-0d15e84c403c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622ec000-c52e-4250-8816-9cc385cb5b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:23 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Volume 573ecb4c-2ba2-480d-8bee-3547ec88ef11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-573ecb4c-2ba2-480d-8bee-3547ec88ef11', 'volume_size': 1} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-522e0f41-f024-4136-86b5-d626661f36a8 tempest-CinderUnicodeTest-739438717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.cf53f0d5-4574-4f48-a22a-37bb566a22cb" returned: 0 in 0.524s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-18e909b7-d841-4994-b0b1-7e1792157b01 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.425s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-522e0f41-f024-4136-86b5-d626661f36a8 tempest-CinderUnicodeTest-739438717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.cf53f0d5-4574-4f48-a22a-37bb566a22cb {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-18e909b7-d841-4994-b0b1-7e1792157b01 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:23 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-18e909b7-d841-4994-b0b1-7e1792157b01 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Deleted volume successfully. Sep 28 17:29:23 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.cf53f0d5-4574-4f48-a22a-37bb566a22cb Sep 28 17:29:23 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:23 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e1732979-c95b-4488-998c-d0251062e278 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.info" returned: 0 in 0.369s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:23 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-e1732979-c95b-4488-998c-d0251062e278 tempest-ProjectMemberTests-584998297 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.info is being set with open permissions: ugo+rw Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e1732979-c95b-4488-998c-d0251062e278 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-18e909b7-d841-4994-b0b1-7e1792157b01 tempest-CreateVolumesFromSourceVolumeTest-839327815 None] Lock "cinder-14a0d9ac-3b36-4357-b3c4-a69dc5d4b2d2-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:23 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.info Sep 28 17:29:23 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:23 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-522e0f41-f024-4136-86b5-d626661f36a8 tempest-CinderUnicodeTest-739438717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98.cf53f0d5-4574-4f48-a22a-37bb566a22cb" returned: 0 in 0.293s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:23 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-522e0f41-f024-4136-86b5-d626661f36a8 tempest-CinderUnicodeTest-739438717 None] Lock "cinder-quobyte-cf53f0d5-4574-4f48-a22a-37bb566a22cb" released by "_delete_snapshot" :: held 2.088s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e1732979-c95b-4488-998c-d0251062e278 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.info" returned: 0 in 0.296s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e1732979-c95b-4488-998c-d0251062e278 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.876s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-522e0f41-f024-4136-86b5-d626661f36a8 tempest-CinderUnicodeTest-739438717 None] Lock "cinder-quobyte-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98" released by "delete_snapshot" :: held 2.154s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.380s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-420186604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=573ecb4c-2ba2-480d-8bee-3547ec88ef11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b564bdb2eb4eb0b9aaea1656070df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:23Z,use_quota=True,user_id='2dcb04c77a78408694c61bd4576909f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Creating volume 573ecb4c-2ba2-480d-8bee-3547ec88ef11 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:23 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-573ecb4c-2ba2-480d-8bee-3547ec88ef11 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:23 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-573ecb4c-2ba2-480d-8bee-3547ec88ef11 1073741824 Sep 28 17:29:23 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:23 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e1732979-c95b-4488-998c-d0251062e278 tempest-ProjectMemberTests-584998297 None] Create snapshot completed successfully Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-522e0f41-f024-4136-86b5-d626661f36a8 tempest-CinderUnicodeTest-739438717 None] Created reservations ['56b88901-aa5b-4e44-8810-4fb9b96c6730', 'a8f2eff4-6fcb-4374-8c02-5c35b8a53715', 'f29c2d0e-1eb3-45c0-9d83-d8dc5f6565a6', '73b80505-0829-4ae0-a1c1-93bdb534dde9'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:23 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-522e0f41-f024-4136-86b5-d626661f36a8 tempest-CinderUnicodeTest-739438717 None] Delete snapshot completed successfully. Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-522e0f41-f024-4136-86b5-d626661f36a8 tempest-CinderUnicodeTest-739438717 None] Lock "cinder-cf53f0d5-4574-4f48-a22a-37bb566a22cb-delete_snapshot" released by "delete_snapshot" :: held 2.411s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4a73af89-65ba-4a4a-9775-a8e0b298244d tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-8a182cba-9732-4b71-a28a-ad572195295c-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4a73af89-65ba-4a4a-9775-a8e0b298244d tempest-ProjectMemberTests-584998297 None] Lock "cinder-8a182cba-9732-4b71-a28a-ad572195295c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4a73af89-65ba-4a4a-9775-a8e0b298244d tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-6fdaa334-2120-4285-83f8-5246e9d98e6e" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4a73af89-65ba-4a4a-9775-a8e0b298244d tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-6fdaa334-2120-4285-83f8-5246e9d98e6e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:23 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4a73af89-65ba-4a4a-9775-a8e0b298244d tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-8a182cba-9732-4b71-a28a-ad572195295c" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4a73af89-65ba-4a4a-9775-a8e0b298244d tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-8a182cba-9732-4b71-a28a-ad572195295c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-4a73af89-65ba-4a4a-9775-a8e0b298244d tempest-ProjectMemberTests-584998297 None] Deleting offline snapshot 8a182cba-9732-4b71-a28a-ad572195295c of volume 6fdaa334-2120-4285-83f8-5246e9d98e6e {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-4a73af89-65ba-4a4a-9775-a8e0b298244d tempest-ProjectMemberTests-584998297 None] snapshot_file for this snap is: volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.8a182cba-9732-4b71-a28a-ad572195295c {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cde6044-9fb8-4df8-9bfc-337c1f7dd3db]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4a73af89-65ba-4a4a-9775-a8e0b298244d tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.8a182cba-9732-4b71-a28a-ad572195295c {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:24 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-573ecb4c-2ba2-480d-8bee-3547ec88ef11 1073741824" returned: 0 in 0.656s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-573ecb4c-2ba2-480d-8bee-3547ec88ef11 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:24 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-573ecb4c-2ba2-480d-8bee-3547ec88ef11 Sep 28 17:29:24 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:24 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.8a182cba-9732-4b71-a28a-ad572195295c Sep 28 17:29:24 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:24 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-573ecb4c-2ba2-480d-8bee-3547ec88ef11" returned: 0 in 0.358s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:24 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4a73af89-65ba-4a4a-9775-a8e0b298244d tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.8a182cba-9732-4b71-a28a-ad572195295c" returned: 0 in 0.465s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-4a73af89-65ba-4a4a-9775-a8e0b298244d tempest-ProjectMemberTests-584998297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fdaa334-2120-4285-83f8-5246e9d98e6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8af228b6-ffd4-4ffa-9451-cef2723e6608 tempest-CinderUnicodeTest-739438717 None] Acquiring lock "cinder-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622ec000-c52e-4250-8816-9cc385cb5b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-573ecb4c-2ba2-480d-8bee-3547ec88ef11', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15454476-5863-4284-be28-27252cc2ef65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7c5539-1848-423d-a005-8b2c62beedcd]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4a73af89-65ba-4a4a-9775-a8e0b298244d tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:24 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Volume volume-573ecb4c-2ba2-480d-8bee-3547ec88ef11 (573ecb4c-2ba2-480d-8bee-3547ec88ef11): created successfully Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15454476-5863-4284-be28-27252cc2ef65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Flow 'volume_create_manager' (d54cd95e-f4fa-4577-baae-9378dfce1878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8af228b6-ffd4-4ffa-9451-cef2723e6608 tempest-CinderUnicodeTest-739438717 None] Lock "cinder-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:24 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e7454f10-43a4-4bf9-a785-e3d283138d09 tempest-ProjectReaderTests-2129792580 None] Created volume successfully. Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8af228b6-ffd4-4ffa-9451-cef2723e6608 tempest-CinderUnicodeTest-739438717 None] Acquiring lock "cinder-quobyte-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8af228b6-ffd4-4ffa-9451-cef2723e6608 tempest-CinderUnicodeTest-739438717 None] Lock "cinder-quobyte-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98" acquired by "delete_volume" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:24 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e Sep 28 17:29:24 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[470729f5-789b-48ac-85cb-f87499be2c63]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8af228b6-ffd4-4ffa-9451-cef2723e6608 tempest-CinderUnicodeTest-739438717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:24 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98 Sep 28 17:29:24 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:25 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4a73af89-65ba-4a4a-9775-a8e0b298244d tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e" returned: 0 in 0.569s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4a73af89-65ba-4a4a-9775-a8e0b298244d tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.8a182cba-9732-4b71-a28a-ad572195295c {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:25 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.8a182cba-9732-4b71-a28a-ad572195295c Sep 28 17:29:25 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:25 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8af228b6-ffd4-4ffa-9451-cef2723e6608 tempest-CinderUnicodeTest-739438717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98" returned: 0 in 0.486s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8af228b6-ffd4-4ffa-9451-cef2723e6608 tempest-CinderUnicodeTest-739438717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:25 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98 Sep 28 17:29:25 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:25 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-17415545-6b27-4962-a9f0-3ad77522a425 tempest-ProjectReaderTests-2129792580 None] Acquiring lock "cinder-573ecb4c-2ba2-480d-8bee-3547ec88ef11-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:25 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-17415545-6b27-4962-a9f0-3ad77522a425 tempest-ProjectReaderTests-2129792580 None] Lock "cinder-573ecb4c-2ba2-480d-8bee-3547ec88ef11-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:25 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-17415545-6b27-4962-a9f0-3ad77522a425 tempest-ProjectReaderTests-2129792580 None] Acquiring lock "cinder-quobyte-573ecb4c-2ba2-480d-8bee-3547ec88ef11" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:25 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:25 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-17415545-6b27-4962-a9f0-3ad77522a425 tempest-ProjectReaderTests-2129792580 None] Lock "cinder-quobyte-573ecb4c-2ba2-480d-8bee-3547ec88ef11" acquired by "delete_volume" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8af228b6-ffd4-4ffa-9451-cef2723e6608 tempest-CinderUnicodeTest-739438717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98" returned: 0 in 0.394s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:25 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3173d2-7a25-4dd1-837c-ecfb9318f3d2]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-17415545-6b27-4962-a9f0-3ad77522a425 tempest-ProjectReaderTests-2129792580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-573ecb4c-2ba2-480d-8bee-3547ec88ef11 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:25 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8af228b6-ffd4-4ffa-9451-cef2723e6608 tempest-CinderUnicodeTest-739438717 None] Lock "cinder-quobyte-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98" released by "delete_volume" :: held 1.005s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:25 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4a73af89-65ba-4a4a-9775-a8e0b298244d tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.8a182cba-9732-4b71-a28a-ad572195295c" returned: 0 in 0.606s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4a73af89-65ba-4a4a-9775-a8e0b298244d tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.8a182cba-9732-4b71-a28a-ad572195295c {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:25 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.8a182cba-9732-4b71-a28a-ad572195295c Sep 28 17:29:25 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:25 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-8af228b6-ffd4-4ffa-9451-cef2723e6608 tempest-CinderUnicodeTest-739438717 None] Created reservations ['76134bd0-65d3-41b8-9689-7bd649669368', '3f347303-cf03-4af4-ad00-ac6e6e75b43d', 'e43fecd3-039f-4b64-82d5-3ee2231696ac', 'b56685e4-dffc-4b08-94e4-f3434dd3787b'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:25 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-573ecb4c-2ba2-480d-8bee-3547ec88ef11 Sep 28 17:29:25 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8af228b6-ffd4-4ffa-9451-cef2723e6608 tempest-CinderUnicodeTest-739438717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8af228b6-ffd4-4ffa-9451-cef2723e6608 tempest-CinderUnicodeTest-739438717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:25 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8af228b6-ffd4-4ffa-9451-cef2723e6608 tempest-CinderUnicodeTest-739438717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:25 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8af228b6-ffd4-4ffa-9451-cef2723e6608 tempest-CinderUnicodeTest-739438717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8af228b6-ffd4-4ffa-9451-cef2723e6608 tempest-CinderUnicodeTest-739438717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8af228b6-ffd4-4ffa-9451-cef2723e6608 tempest-CinderUnicodeTest-739438717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:26 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:26 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:26 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4a73af89-65ba-4a4a-9775-a8e0b298244d tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e.8a182cba-9732-4b71-a28a-ad572195295c" returned: 0 in 0.416s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4a73af89-65ba-4a4a-9775-a8e0b298244d tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-8a182cba-9732-4b71-a28a-ad572195295c" released by "_delete_snapshot" :: held 2.235s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4a73af89-65ba-4a4a-9775-a8e0b298244d tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-6fdaa334-2120-4285-83f8-5246e9d98e6e" released by "delete_snapshot" :: held 2.271s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:26 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:26 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8af228b6-ffd4-4ffa-9451-cef2723e6608 tempest-CinderUnicodeTest-739438717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.342s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-17415545-6b27-4962-a9f0-3ad77522a425 tempest-ProjectReaderTests-2129792580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-573ecb4c-2ba2-480d-8bee-3547ec88ef11" returned: 0 in 0.610s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:26 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-8af228b6-ffd4-4ffa-9451-cef2723e6608 tempest-CinderUnicodeTest-739438717 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-17415545-6b27-4962-a9f0-3ad77522a425 tempest-ProjectReaderTests-2129792580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-573ecb4c-2ba2-480d-8bee-3547ec88ef11 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:26 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-8af228b6-ffd4-4ffa-9451-cef2723e6608 tempest-CinderUnicodeTest-739438717 None] Deleted volume successfully. Sep 28 17:29:26 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-573ecb4c-2ba2-480d-8bee-3547ec88ef11 Sep 28 17:29:26 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8af228b6-ffd4-4ffa-9451-cef2723e6608 tempest-CinderUnicodeTest-739438717 None] Lock "cinder-31f21a8a-09a3-442d-b7cf-5c8cedb0fe98-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:26 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-4a73af89-65ba-4a4a-9775-a8e0b298244d tempest-ProjectMemberTests-584998297 None] Created reservations ['2de27284-253f-49ee-ab41-ad009275471e', 'f24fb978-8bed-4247-8451-5c3b69842d4c', 'a84fc0d6-45b7-471d-8d3f-71a6993fae77', 'd45bb18f-2717-41ed-96f0-5a63bbbd1a69'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:26 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-4a73af89-65ba-4a4a-9775-a8e0b298244d tempest-ProjectMemberTests-584998297 None] Delete snapshot completed successfully. Sep 28 17:29:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4a73af89-65ba-4a4a-9775-a8e0b298244d tempest-ProjectMemberTests-584998297 None] Lock "cinder-8a182cba-9732-4b71-a28a-ad572195295c-delete_snapshot" released by "delete_snapshot" :: held 2.517s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:26 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-17415545-6b27-4962-a9f0-3ad77522a425 tempest-ProjectReaderTests-2129792580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-573ecb4c-2ba2-480d-8bee-3547ec88ef11" returned: 0 in 0.350s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-17415545-6b27-4962-a9f0-3ad77522a425 tempest-ProjectReaderTests-2129792580 None] Lock "cinder-quobyte-573ecb4c-2ba2-480d-8bee-3547ec88ef11" released by "delete_volume" :: held 1.038s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:26 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-17415545-6b27-4962-a9f0-3ad77522a425 tempest-ProjectReaderTests-2129792580 None] Created reservations ['60fa68bf-5cc7-4db0-9338-2f826654e33b', '448e1f30-3585-42fb-9d17-38cb13ed38c6', '5fb959d7-f9ff-440b-8690-4d9b845b3d8f', '7a6de7bb-d7f9-4c8e-ac80-fe6716440901'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-17415545-6b27-4962-a9f0-3ad77522a425 tempest-ProjectReaderTests-2129792580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-17415545-6b27-4962-a9f0-3ad77522a425 tempest-ProjectReaderTests-2129792580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-17415545-6b27-4962-a9f0-3ad77522a425 tempest-ProjectReaderTests-2129792580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:26 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-17415545-6b27-4962-a9f0-3ad77522a425 tempest-ProjectReaderTests-2129792580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-17415545-6b27-4962-a9f0-3ad77522a425 tempest-ProjectReaderTests-2129792580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-17415545-6b27-4962-a9f0-3ad77522a425 tempest-ProjectReaderTests-2129792580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2990d82e-57f5-42d8-a653-9391fad03f1b tempest-CinderUnicodeTest-739438717 None] Acquiring lock "cinder-ce97c0db-62cc-4b05-97ea-1f058e75d88c-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:26 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:26 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2990d82e-57f5-42d8-a653-9391fad03f1b tempest-CinderUnicodeTest-739438717 None] Lock "cinder-ce97c0db-62cc-4b05-97ea-1f058e75d88c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2990d82e-57f5-42d8-a653-9391fad03f1b tempest-CinderUnicodeTest-739438717 None] Acquiring lock "cinder-quobyte-ce97c0db-62cc-4b05-97ea-1f058e75d88c" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2990d82e-57f5-42d8-a653-9391fad03f1b tempest-CinderUnicodeTest-739438717 None] Lock "cinder-quobyte-ce97c0db-62cc-4b05-97ea-1f058e75d88c" acquired by "delete_volume" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f17550-a9a9-44ea-9c5d-f11f68aeeb7a]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2990d82e-57f5-42d8-a653-9391fad03f1b tempest-CinderUnicodeTest-739438717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce97c0db-62cc-4b05-97ea-1f058e75d88c {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4650b5b2-2ff7-48da-a763-09290bc45f9b tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-6fdaa334-2120-4285-83f8-5246e9d98e6e-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:27 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce97c0db-62cc-4b05-97ea-1f058e75d88c Sep 28 17:29:27 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4650b5b2-2ff7-48da-a763-09290bc45f9b tempest-ProjectMemberTests-584998297 None] Lock "cinder-6fdaa334-2120-4285-83f8-5246e9d98e6e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:27 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-17415545-6b27-4962-a9f0-3ad77522a425 tempest-ProjectReaderTests-2129792580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.434s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-17415545-6b27-4962-a9f0-3ad77522a425 tempest-ProjectReaderTests-2129792580 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4650b5b2-2ff7-48da-a763-09290bc45f9b tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-6fdaa334-2120-4285-83f8-5246e9d98e6e" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:27 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-17415545-6b27-4962-a9f0-3ad77522a425 tempest-ProjectReaderTests-2129792580 None] Deleted volume successfully. Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4650b5b2-2ff7-48da-a763-09290bc45f9b tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-6fdaa334-2120-4285-83f8-5246e9d98e6e" acquired by "delete_volume" :: waited 0.028s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-17415545-6b27-4962-a9f0-3ad77522a425 tempest-ProjectReaderTests-2129792580 None] Lock "cinder-573ecb4c-2ba2-480d-8bee-3547ec88ef11-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa51ce68-7369-41e9-ab0f-dcbbe75b665e]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4650b5b2-2ff7-48da-a763-09290bc45f9b tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:27 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e Sep 28 17:29:27 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:27 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2990d82e-57f5-42d8-a653-9391fad03f1b tempest-CinderUnicodeTest-739438717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce97c0db-62cc-4b05-97ea-1f058e75d88c" returned: 0 in 0.510s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2990d82e-57f5-42d8-a653-9391fad03f1b tempest-CinderUnicodeTest-739438717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce97c0db-62cc-4b05-97ea-1f058e75d88c {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:27 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce97c0db-62cc-4b05-97ea-1f058e75d88c Sep 28 17:29:27 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:27 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4650b5b2-2ff7-48da-a763-09290bc45f9b tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e" returned: 0 in 0.479s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4650b5b2-2ff7-48da-a763-09290bc45f9b tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=224,cinder:UPDATE=295,cinder:DELETE=30,cinder:INSERT=82 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:29:27 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:27 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e Sep 28 17:29:27 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2990d82e-57f5-42d8-a653-9391fad03f1b tempest-CinderUnicodeTest-739438717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce97c0db-62cc-4b05-97ea-1f058e75d88c" returned: 0 in 0.332s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=219,cinder:UPDATE=303,cinder:INSERT=79,cinder:DELETE=23 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2990d82e-57f5-42d8-a653-9391fad03f1b tempest-CinderUnicodeTest-739438717 None] Lock "cinder-quobyte-ce97c0db-62cc-4b05-97ea-1f058e75d88c" released by "delete_volume" :: held 0.915s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Flow 'volume_create_manager' (ac3617de-a331-4237-9600-ab7f5fa7049d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:27 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87735791-a694-4aea-8655-e0781017fa93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87735791-a694-4aea-8655-e0781017fa93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-846887559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc4e516-56fc-47da-82ba-d53df5aca3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25a1f7122ba64603be8e63f7b5f1c35f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:28Z,use_quota=True,user_id='139fc07435db4c428c84d34afa19c67c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a4d600-fdee-4d0c-ab0b-2ad06a6fbb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a4d600-fdee-4d0c-ab0b-2ad06a6fbb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (418d5666-26e8-446e-b5bf-ae8dddfd7232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (418d5666-26e8-446e-b5bf-ae8dddfd7232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dc4e516-56fc-47da-82ba-d53df5aca3f4', 'volume_name': 'volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b82f849-2678-43a0-8a40-e2dfe509e403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b82f849-2678-43a0-8a40-e2dfe509e403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a67e87d-85c6-4d03-ab97-0445de679b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:28 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Volume 4dc4e516-56fc-47da-82ba-d53df5aca3f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4', 'volume_size': 1} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-846887559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc4e516-56fc-47da-82ba-d53df5aca3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25a1f7122ba64603be8e63f7b5f1c35f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:28Z,use_quota=True,user_id='139fc07435db4c428c84d34afa19c67c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Creating volume 4dc4e516-56fc-47da-82ba-d53df5aca3f4 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:28 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:28 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 1073741824 Sep 28 17:29:28 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-2990d82e-57f5-42d8-a653-9391fad03f1b tempest-CinderUnicodeTest-739438717 None] Created reservations ['97645199-cc10-49e1-b4d4-ada5eaa21049', 'e4280408-a028-4d6c-91d5-dcab3c50ad9d', 'cfa286ba-0f2c-48ed-b9e0-ba56ad017070', '01a12ea7-9d9c-4a77-8092-d9eaf3f639b6'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:28 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4650b5b2-2ff7-48da-a763-09290bc45f9b tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-6fdaa334-2120-4285-83f8-5246e9d98e6e" returned: 0 in 0.363s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4650b5b2-2ff7-48da-a763-09290bc45f9b tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-6fdaa334-2120-4285-83f8-5246e9d98e6e" released by "delete_volume" :: held 0.947s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2990d82e-57f5-42d8-a653-9391fad03f1b tempest-CinderUnicodeTest-739438717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2990d82e-57f5-42d8-a653-9391fad03f1b tempest-CinderUnicodeTest-739438717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2990d82e-57f5-42d8-a653-9391fad03f1b tempest-CinderUnicodeTest-739438717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2990d82e-57f5-42d8-a653-9391fad03f1b tempest-CinderUnicodeTest-739438717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2990d82e-57f5-42d8-a653-9391fad03f1b tempest-CinderUnicodeTest-739438717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2990d82e-57f5-42d8-a653-9391fad03f1b tempest-CinderUnicodeTest-739438717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-4650b5b2-2ff7-48da-a763-09290bc45f9b tempest-ProjectMemberTests-584998297 None] Created reservations ['1b712f97-8fdc-4a39-b317-816edcc1f636', 'e4aac7b1-347d-410f-9ec2-5ca9b64b9ae2', '593a4f12-e163-4e23-b835-c557e6fa3f7b', 'afd53570-9bed-46d5-a476-64c56fc0da8b'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:28 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:28 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Flow 'volume_create_manager' (c6098dec-7a7f-4d63-8188-de4f43cc8c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe4aaad-c963-4a3e-bc70-4b1a80ff8f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4650b5b2-2ff7-48da-a763-09290bc45f9b tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4650b5b2-2ff7-48da-a763-09290bc45f9b tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4650b5b2-2ff7-48da-a763-09290bc45f9b tempest-ProjectMemberTests-584998297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4650b5b2-2ff7-48da-a763-09290bc45f9b tempest-ProjectMemberTests-584998297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4650b5b2-2ff7-48da-a763-09290bc45f9b tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4650b5b2-2ff7-48da-a763-09290bc45f9b tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe4aaad-c963-4a3e-bc70-4b1a80ff8f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1234911495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3193440-8d54-4e30-8a08-75eacf0446d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b564bdb2eb4eb0b9aaea1656070df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:28Z,use_quota=True,user_id='2dcb04c77a78408694c61bd4576909f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd64d8f7-06fd-4cbc-8f48-2686b7c9ddcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:28 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:28 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd64d8f7-06fd-4cbc-8f48-2686b7c9ddcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca07c64-cda6-4ca7-a834-27d86f9b60c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:28 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca07c64-cda6-4ca7-a834-27d86f9b60c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3193440-8d54-4e30-8a08-75eacf0446d6', 'volume_name': 'volume-f3193440-8d54-4e30-8a08-75eacf0446d6', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d9fe59-1659-46c2-82ee-0ef831ccf404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d9fe59-1659-46c2-82ee-0ef831ccf404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd23f50-2862-461f-9960-1c3fe84d5dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:28 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Volume f3193440-8d54-4e30-8a08-75eacf0446d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3193440-8d54-4e30-8a08-75eacf0446d6', 'volume_size': 1} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2990d82e-57f5-42d8-a653-9391fad03f1b tempest-CinderUnicodeTest-739438717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.330s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-2990d82e-57f5-42d8-a653-9391fad03f1b tempest-CinderUnicodeTest-739438717 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:28 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-2990d82e-57f5-42d8-a653-9391fad03f1b tempest-CinderUnicodeTest-739438717 None] Deleted volume successfully. Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2990d82e-57f5-42d8-a653-9391fad03f1b tempest-CinderUnicodeTest-739438717 None] Lock "cinder-ce97c0db-62cc-4b05-97ea-1f058e75d88c-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:28 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 1073741824" returned: 0 in 0.683s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:28 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 Sep 28 17:29:28 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:28 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4650b5b2-2ff7-48da-a763-09290bc45f9b tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.318s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:28 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-4650b5b2-2ff7-48da-a763-09290bc45f9b tempest-ProjectMemberTests-584998297 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:28 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-4650b5b2-2ff7-48da-a763-09290bc45f9b tempest-ProjectMemberTests-584998297 None] Deleted volume successfully. Sep 28 17:29:29 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4650b5b2-2ff7-48da-a763-09290bc45f9b tempest-ProjectMemberTests-584998297 None] Lock "cinder-6fdaa334-2120-4285-83f8-5246e9d98e6e-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:29 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4" returned: 0 in 0.286s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.383s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1234911495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3193440-8d54-4e30-8a08-75eacf0446d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b564bdb2eb4eb0b9aaea1656070df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:28Z,use_quota=True,user_id='2dcb04c77a78408694c61bd4576909f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Creating volume f3193440-8d54-4e30-8a08-75eacf0446d6 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:29 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:29:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f3193440-8d54-4e30-8a08-75eacf0446d6 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a67e87d-85c6-4d03-ab97-0445de679b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:29 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f3193440-8d54-4e30-8a08-75eacf0446d6 1073741824 Sep 28 17:29:29 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d798b74-f731-4b18-a38e-65b6dcc54d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:29 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Volume volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 (4dc4e516-56fc-47da-82ba-d53df5aca3f4): created successfully Sep 28 17:29:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d798b74-f731-4b18-a38e-65b6dcc54d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Flow 'volume_create_manager' (ac3617de-a331-4237-9600-ab7f5fa7049d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:29 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-f07b7a06-db4c-47d2-9df7-309829d3b7eb tempest-VolumeDependencyTests-484233325 None] Created volume successfully. Sep 28 17:29:29 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f3193440-8d54-4e30-8a08-75eacf0446d6 1073741824" returned: 0 in 0.602s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f3193440-8d54-4e30-8a08-75eacf0446d6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:29 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f3193440-8d54-4e30-8a08-75eacf0446d6 Sep 28 17:29:29 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:30 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f3193440-8d54-4e30-8a08-75eacf0446d6" returned: 0 in 0.324s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd23f50-2862-461f-9960-1c3fe84d5dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3193440-8d54-4e30-8a08-75eacf0446d6', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (879d98f5-c200-4ca0-9fa6-ba183e49e8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:30 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Volume volume-f3193440-8d54-4e30-8a08-75eacf0446d6 (f3193440-8d54-4e30-8a08-75eacf0446d6): created successfully Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (879d98f5-c200-4ca0-9fa6-ba183e49e8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Flow 'volume_create_manager' (c6098dec-7a7f-4d63-8188-de4f43cc8c50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:30 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d8d3f683-1864-45b1-a91d-79e25b292fc0 tempest-ProjectReaderTests-2129792580 None] Created volume successfully. Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Flow 'volume_create_manager' (fae29a48-125b-41a0-af6a-df55b03f3ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdae7567-4e1c-453e-9ebb-7e6453033ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdae7567-4e1c-453e-9ebb-7e6453033ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1221236902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802bbb47-e245-448a-98e4-eaf9fc400a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716b289f0179458f8e2e869e7ff71485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:30Z,use_quota=True,user_id='ccaca5bfad8b4b96b2ae3b66012f813b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a391894-7439-41cb-a39d-6700dee95c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a391894-7439-41cb-a39d-6700dee95c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d2b675-100b-4fed-b2ac-65df9b7d2330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d2b675-100b-4fed-b2ac-65df9b7d2330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '802bbb47-e245-448a-98e4-eaf9fc400a4d', 'volume_name': 'volume-802bbb47-e245-448a-98e4-eaf9fc400a4d', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eeb3969-18be-4e72-bd16-1bcd2876319f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eeb3969-18be-4e72-bd16-1bcd2876319f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (021f4645-37c2-40fe-9744-4a15a8f6038c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:30 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Volume 802bbb47-e245-448a-98e4-eaf9fc400a4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-802bbb47-e245-448a-98e4-eaf9fc400a4d', 'volume_size': 1} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1221236902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802bbb47-e245-448a-98e4-eaf9fc400a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716b289f0179458f8e2e869e7ff71485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:30Z,use_quota=True,user_id='ccaca5bfad8b4b96b2ae3b66012f813b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Creating volume 802bbb47-e245-448a-98e4-eaf9fc400a4d {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:30 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-776e70c1-b6e3-46f4-bff8-953bd6b4213b tempest-VolumeDependencyTests-484233325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:30 devstack sudo[108350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d 1073741824 Sep 28 17:29:30 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:30 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-cde2fc3c-c727-4836-82e6-7d54d1d3a0fd tempest-ProjectReaderTests-2129792580 None] Acquiring lock "cinder-f3193440-8d54-4e30-8a08-75eacf0446d6-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d 1073741824" returned: 0 in 0.561s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-cde2fc3c-c727-4836-82e6-7d54d1d3a0fd tempest-ProjectReaderTests-2129792580 None] Lock "cinder-f3193440-8d54-4e30-8a08-75eacf0446d6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:31 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d Sep 28 17:29:31 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-cde2fc3c-c727-4836-82e6-7d54d1d3a0fd tempest-ProjectReaderTests-2129792580 None] Acquiring lock "cinder-quobyte-f3193440-8d54-4e30-8a08-75eacf0446d6" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-cde2fc3c-c727-4836-82e6-7d54d1d3a0fd tempest-ProjectReaderTests-2129792580 None] Lock "cinder-quobyte-f3193440-8d54-4e30-8a08-75eacf0446d6" acquired by "delete_volume" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb26307-5895-4c77-95d7-1b5b18ff212e]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cde2fc3c-c727-4836-82e6-7d54d1d3a0fd tempest-ProjectReaderTests-2129792580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f3193440-8d54-4e30-8a08-75eacf0446d6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:31 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f3193440-8d54-4e30-8a08-75eacf0446d6 Sep 28 17:29:31 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:31 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d" returned: 0 in 0.317s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-776e70c1-b6e3-46f4-bff8-953bd6b4213b tempest-VolumeDependencyTests-484233325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.943s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-776e70c1-b6e3-46f4-bff8-953bd6b4213b tempest-VolumeDependencyTests-484233325 None] Creating offline snapshot f377596a-405f-46ae-a3ab-15e3b64da6c5 of volume 4dc4e516-56fc-47da-82ba-d53df5aca3f4 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (021f4645-37c2-40fe-9744-4a15a8f6038c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-802bbb47-e245-448a-98e4-eaf9fc400a4d', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a725660c-63e6-429d-89a1-e2bf993d9be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef02c222-9d38-46e4-b57d-06956112fe59]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-776e70c1-b6e3-46f4-bff8-953bd6b4213b tempest-VolumeDependencyTests-484233325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:31 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Volume volume-802bbb47-e245-448a-98e4-eaf9fc400a4d (802bbb47-e245-448a-98e4-eaf9fc400a4d): created successfully Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a725660c-63e6-429d-89a1-e2bf993d9be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Flow 'volume_create_manager' (fae29a48-125b-41a0-af6a-df55b03f3ed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:31 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-0030b47c-fef1-44b4-ad30-d3d4912fba07 tempest-ProjectMemberTests-584998297 None] Created volume successfully. Sep 28 17:29:31 devstack sudo[108361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 Sep 28 17:29:31 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:31 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cde2fc3c-c727-4836-82e6-7d54d1d3a0fd tempest-ProjectReaderTests-2129792580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f3193440-8d54-4e30-8a08-75eacf0446d6" returned: 0 in 0.442s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cde2fc3c-c727-4836-82e6-7d54d1d3a0fd tempest-ProjectReaderTests-2129792580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f3193440-8d54-4e30-8a08-75eacf0446d6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:31 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f3193440-8d54-4e30-8a08-75eacf0446d6 Sep 28 17:29:31 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:31 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-776e70c1-b6e3-46f4-bff8-953bd6b4213b tempest-VolumeDependencyTests-484233325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4" returned: 0 in 0.457s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-776e70c1-b6e3-46f4-bff8-953bd6b4213b tempest-VolumeDependencyTests-484233325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:31 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cde2fc3c-c727-4836-82e6-7d54d1d3a0fd tempest-ProjectReaderTests-2129792580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f3193440-8d54-4e30-8a08-75eacf0446d6" returned: 0 in 0.305s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:31 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5 1G Sep 28 17:29:31 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-cde2fc3c-c727-4836-82e6-7d54d1d3a0fd tempest-ProjectReaderTests-2129792580 None] Lock "cinder-quobyte-f3193440-8d54-4e30-8a08-75eacf0446d6" released by "delete_volume" :: held 0.814s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:31 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-cde2fc3c-c727-4836-82e6-7d54d1d3a0fd tempest-ProjectReaderTests-2129792580 None] Created reservations ['b4916123-023d-4a1d-83f4-78da4fdcb625', '9625e01a-3271-44a1-bc01-c26db846f36b', 'b939d152-f81d-4c39-8154-e31482153377', '4b1bd8b1-e2a0-4e74-b6ac-5e0344535d1a'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cde2fc3c-c727-4836-82e6-7d54d1d3a0fd tempest-ProjectReaderTests-2129792580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cde2fc3c-c727-4836-82e6-7d54d1d3a0fd tempest-ProjectReaderTests-2129792580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cde2fc3c-c727-4836-82e6-7d54d1d3a0fd tempest-ProjectReaderTests-2129792580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cde2fc3c-c727-4836-82e6-7d54d1d3a0fd tempest-ProjectReaderTests-2129792580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cde2fc3c-c727-4836-82e6-7d54d1d3a0fd tempest-ProjectReaderTests-2129792580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cde2fc3c-c727-4836-82e6-7d54d1d3a0fd tempest-ProjectReaderTests-2129792580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:32 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:32 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:32 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-776e70c1-b6e3-46f4-bff8-953bd6b4213b tempest-VolumeDependencyTests-484233325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5 1G" returned: 0 in 0.654s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-776e70c1-b6e3-46f4-bff8-953bd6b4213b tempest-VolumeDependencyTests-484233325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:32 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5 Sep 28 17:29:32 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-19eb5ba6-87a5-4ea3-a540-eb2a445bfdd4 tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:32 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cde2fc3c-c727-4836-82e6-7d54d1d3a0fd tempest-ProjectReaderTests-2129792580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.524s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:32 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-cde2fc3c-c727-4836-82e6-7d54d1d3a0fd tempest-ProjectReaderTests-2129792580 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:32 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-cde2fc3c-c727-4836-82e6-7d54d1d3a0fd tempest-ProjectReaderTests-2129792580 None] Deleted volume successfully. Sep 28 17:29:32 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-cde2fc3c-c727-4836-82e6-7d54d1d3a0fd tempest-ProjectReaderTests-2129792580 None] Lock "cinder-f3193440-8d54-4e30-8a08-75eacf0446d6-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:32 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-776e70c1-b6e3-46f4-bff8-953bd6b4213b tempest-VolumeDependencyTests-484233325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5" returned: 0 in 0.482s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:32 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-776e70c1-b6e3-46f4-bff8-953bd6b4213b tempest-VolumeDependencyTests-484233325 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5 is being set with open permissions: ugo+rw Sep 28 17:29:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-776e70c1-b6e3-46f4-bff8-953bd6b4213b tempest-VolumeDependencyTests-484233325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:33 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5 Sep 28 17:29:33 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:33 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-776e70c1-b6e3-46f4-bff8-953bd6b4213b tempest-VolumeDependencyTests-484233325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5" returned: 0 in 0.275s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-776e70c1-b6e3-46f4-bff8-953bd6b4213b tempest-VolumeDependencyTests-484233325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:33 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.info Sep 28 17:29:33 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:33 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-776e70c1-b6e3-46f4-bff8-953bd6b4213b tempest-VolumeDependencyTests-484233325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.info" returned: 0 in 0.291s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:33 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-776e70c1-b6e3-46f4-bff8-953bd6b4213b tempest-VolumeDependencyTests-484233325 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.info is being set with open permissions: ugo+rw Sep 28 17:29:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-776e70c1-b6e3-46f4-bff8-953bd6b4213b tempest-VolumeDependencyTests-484233325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:33 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.info Sep 28 17:29:33 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:33 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-776e70c1-b6e3-46f4-bff8-953bd6b4213b tempest-VolumeDependencyTests-484233325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.info" returned: 0 in 0.312s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-776e70c1-b6e3-46f4-bff8-953bd6b4213b tempest-VolumeDependencyTests-484233325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.600s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-19eb5ba6-87a5-4ea3-a540-eb2a445bfdd4 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.252s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:33 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-19eb5ba6-87a5-4ea3-a540-eb2a445bfdd4 tempest-ProjectMemberTests-584998297 None] Creating offline snapshot 30d88d20-de33-465a-b9fe-b743d965fde2 of volume 802bbb47-e245-448a-98e4-eaf9fc400a4d {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:29:33 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-776e70c1-b6e3-46f4-bff8-953bd6b4213b tempest-VolumeDependencyTests-484233325 None] Create snapshot completed successfully Sep 28 17:29:34 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8767510-0e00-4695-8ddf-5c18e325a7ab]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19eb5ba6-87a5-4ea3-a540-eb2a445bfdd4 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:34 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d Sep 28 17:29:34 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:34 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19eb5ba6-87a5-4ea3-a540-eb2a445bfdd4 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d" returned: 0 in 0.434s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19eb5ba6-87a5-4ea3-a540-eb2a445bfdd4 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.30d88d20-de33-465a-b9fe-b743d965fde2 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:34 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.30d88d20-de33-465a-b9fe-b743d965fde2 1G Sep 28 17:29:34 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:35 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19eb5ba6-87a5-4ea3-a540-eb2a445bfdd4 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.30d88d20-de33-465a-b9fe-b743d965fde2 1G" returned: 0 in 0.569s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19eb5ba6-87a5-4ea3-a540-eb2a445bfdd4 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802bbb47-e245-448a-98e4-eaf9fc400a4d -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.30d88d20-de33-465a-b9fe-b743d965fde2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:35 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802bbb47-e245-448a-98e4-eaf9fc400a4d -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.30d88d20-de33-465a-b9fe-b743d965fde2 Sep 28 17:29:35 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:35 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Flow 'volume_create_manager' (d8925db3-e2b8-46ad-b3e1-073058608dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59a03f2-f49a-42e8-8dd0-20b2be28e125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59a03f2-f49a-42e8-8dd0-20b2be28e125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1850550203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9434c098-e6d4-480d-98fd-7e1d51e728ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25a1f7122ba64603be8e63f7b5f1c35f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f377596a-405f-46ae-a3ab-15e3b64da6c5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:35Z,use_quota=True,user_id='139fc07435db4c428c84d34afa19c67c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d2e4ff-1b3e-41f3-83a2-42dafa82bf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d2e4ff-1b3e-41f3-83a2-42dafa82bf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb0be84-1096-4676-9a4b-0f47dab5ff93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb0be84-1096-4676-9a4b-0f47dab5ff93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9434c098-e6d4-480d-98fd-7e1d51e728ea', 'volume_name': 'volume-9434c098-e6d4-480d-98fd-7e1d51e728ea', 'volume_size': 1, 'snapshot_id': 'f377596a-405f-46ae-a3ab-15e3b64da6c5'}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3306380f-fd81-4fb7-90de-461565598760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3306380f-fd81-4fb7-90de-461565598760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:35 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef5f07d-8ad4-4865-b4ec-65bcf63b9fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:35 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Volume 9434c098-e6d4-480d-98fd-7e1d51e728ea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9434c098-e6d4-480d-98fd-7e1d51e728ea', 'volume_size': 1, 'snapshot_id': 'f377596a-405f-46ae-a3ab-15e3b64da6c5'} Sep 28 17:29:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:35 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19eb5ba6-87a5-4ea3-a540-eb2a445bfdd4 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802bbb47-e245-448a-98e4-eaf9fc400a4d -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.30d88d20-de33-465a-b9fe-b743d965fde2" returned: 0 in 0.427s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:35 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-19eb5ba6-87a5-4ea3-a540-eb2a445bfdd4 tempest-ProjectMemberTests-584998297 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.30d88d20-de33-465a-b9fe-b743d965fde2 is being set with open permissions: ugo+rw Sep 28 17:29:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19eb5ba6-87a5-4ea3-a540-eb2a445bfdd4 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.30d88d20-de33-465a-b9fe-b743d965fde2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:35 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.30d88d20-de33-465a-b9fe-b743d965fde2 Sep 28 17:29:35 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:35 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19eb5ba6-87a5-4ea3-a540-eb2a445bfdd4 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.30d88d20-de33-465a-b9fe-b743d965fde2" returned: 0 in 0.307s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19eb5ba6-87a5-4ea3-a540-eb2a445bfdd4 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:35 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.info Sep 28 17:29:35 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:36 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19eb5ba6-87a5-4ea3-a540-eb2a445bfdd4 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.info" returned: 0 in 0.283s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:36 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-19eb5ba6-87a5-4ea3-a540-eb2a445bfdd4 tempest-ProjectMemberTests-584998297 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.info is being set with open permissions: ugo+rw Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19eb5ba6-87a5-4ea3-a540-eb2a445bfdd4 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:36 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.info Sep 28 17:29:36 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:36 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-19eb5ba6-87a5-4ea3-a540-eb2a445bfdd4 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.info" returned: 0 in 0.325s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-19eb5ba6-87a5-4ea3-a540-eb2a445bfdd4 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.482s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Acquiring lock "cinder-quobyte-f377596a-405f-46ae-a3ab-15e3b64da6c5-9434c098-e6d4-480d-98fd-7e1d51e728ea" by "_create_volume_from_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Lock "cinder-quobyte-f377596a-405f-46ae-a3ab-15e3b64da6c5-9434c098-e6d4-480d-98fd-7e1d51e728ea" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Creating volume 9434c098-e6d4-480d-98fd-7e1d51e728ea from snapshot f377596a-405f-46ae-a3ab-15e3b64da6c5 {{(pid=87061) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Acquiring lock "cinder-quobyte-9434c098-e6d4-480d-98fd-7e1d51e728ea" by "_copy_volume_from_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:36 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-19eb5ba6-87a5-4ea3-a540-eb2a445bfdd4 tempest-ProjectMemberTests-584998297 None] Create snapshot completed successfully Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Lock "cinder-quobyte-9434c098-e6d4-480d-98fd-7e1d51e728ea" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] snapshot: f377596a-405f-46ae-a3ab-15e3b64da6c5, volume: 9434c098-e6d4-480d-98fd-7e1d51e728ea, {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eb1b50-59d0-424a-81e3-91fe25e0d7d5]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:36 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5 Sep 28 17:29:36 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a558d6a9-d809-4f4c-a668-e2078c8c4c90 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-30d88d20-de33-465a-b9fe-b743d965fde2-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a558d6a9-d809-4f4c-a668-e2078c8c4c90 tempest-ProjectMemberTests-584998297 None] Lock "cinder-30d88d20-de33-465a-b9fe-b743d965fde2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a558d6a9-d809-4f4c-a668-e2078c8c4c90 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-802bbb47-e245-448a-98e4-eaf9fc400a4d" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a558d6a9-d809-4f4c-a668-e2078c8c4c90 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-802bbb47-e245-448a-98e4-eaf9fc400a4d" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a558d6a9-d809-4f4c-a668-e2078c8c4c90 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-30d88d20-de33-465a-b9fe-b743d965fde2" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a558d6a9-d809-4f4c-a668-e2078c8c4c90 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-30d88d20-de33-465a-b9fe-b743d965fde2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-a558d6a9-d809-4f4c-a668-e2078c8c4c90 tempest-ProjectMemberTests-584998297 None] Deleting offline snapshot 30d88d20-de33-465a-b9fe-b743d965fde2 of volume 802bbb47-e245-448a-98e4-eaf9fc400a4d {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:29:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-a558d6a9-d809-4f4c-a668-e2078c8c4c90 tempest-ProjectMemberTests-584998297 None] snapshot_file for this snap is: volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.30d88d20-de33-465a-b9fe-b743d965fde2 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:29:37 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b36df79-33cc-48d6-bec2-9430551a773f]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a558d6a9-d809-4f4c-a668-e2078c8c4c90 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.30d88d20-de33-465a-b9fe-b743d965fde2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:37 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5" returned: 0 in 0.593s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:29:37 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bbf8d4-23fe-49e7-a2cd-e2e6f1c8a84d]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:37 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.30d88d20-de33-465a-b9fe-b743d965fde2 Sep 28 17:29:37 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:37 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 Sep 28 17:29:37 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:37 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a558d6a9-d809-4f4c-a668-e2078c8c4c90 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.30d88d20-de33-465a-b9fe-b743d965fde2" returned: 0 in 0.515s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-a558d6a9-d809-4f4c-a668-e2078c8c4c90 tempest-ProjectMemberTests-584998297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-802bbb47-e245-448a-98e4-eaf9fc400a4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:29:37 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4" returned: 0 in 0.512s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:29:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Creating direct copy from snapshot {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:29:37 devstack cinder-volume[87061]: DEBUG cinder.utils [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Path /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9434c098-e6d4-480d-98fd-7e1d51e728ea not found in is_blk_device check {{(pid=87061) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:29:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9434c098-e6d4-480d-98fd-7e1d51e728ea {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:37 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[3251a176-5f0c-4819-86f3-35cf8758eadc]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a558d6a9-d809-4f4c-a668-e2078c8c4c90 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:37 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9434c098-e6d4-480d-98fd-7e1d51e728ea Sep 28 17:29:37 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:37 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d Sep 28 17:29:37 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:38 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a558d6a9-d809-4f4c-a668-e2078c8c4c90 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d" returned: 0 in 0.602s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a558d6a9-d809-4f4c-a668-e2078c8c4c90 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.30d88d20-de33-465a-b9fe-b743d965fde2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:38 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.30d88d20-de33-465a-b9fe-b743d965fde2 Sep 28 17:29:38 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:39 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a558d6a9-d809-4f4c-a668-e2078c8c4c90 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.30d88d20-de33-465a-b9fe-b743d965fde2" returned: 0 in 0.795s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a558d6a9-d809-4f4c-a668-e2078c8c4c90 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.30d88d20-de33-465a-b9fe-b743d965fde2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:39 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.30d88d20-de33-465a-b9fe-b743d965fde2 Sep 28 17:29:39 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:39 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a558d6a9-d809-4f4c-a668-e2078c8c4c90 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d.30d88d20-de33-465a-b9fe-b743d965fde2" returned: 0 in 0.650s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a558d6a9-d809-4f4c-a668-e2078c8c4c90 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-30d88d20-de33-465a-b9fe-b743d965fde2" released by "_delete_snapshot" :: held 2.799s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a558d6a9-d809-4f4c-a668-e2078c8c4c90 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-802bbb47-e245-448a-98e4-eaf9fc400a4d" released by "delete_snapshot" :: held 2.841s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:40 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-a558d6a9-d809-4f4c-a668-e2078c8c4c90 tempest-ProjectMemberTests-584998297 None] Created reservations ['a563b77b-4890-4ba4-8486-f3181a3b4b63', '059cf70f-b1ab-48fd-9cae-d7d7defe40df', 'c2078720-33fe-4f3d-b87a-db4e95a7ff81', 'a0751cc5-c99e-4815-ab16-2bc2941dca2a'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:40 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a558d6a9-d809-4f4c-a668-e2078c8c4c90 tempest-ProjectMemberTests-584998297 None] Delete snapshot completed successfully. Sep 28 17:29:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-a558d6a9-d809-4f4c-a668-e2078c8c4c90 tempest-ProjectMemberTests-584998297 None] Lock "cinder-30d88d20-de33-465a-b9fe-b743d965fde2-delete_snapshot" released by "delete_snapshot" :: held 3.196s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d39b1a95-cb4d-4e46-a468-a27009a95026 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-802bbb47-e245-448a-98e4-eaf9fc400a4d-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d39b1a95-cb4d-4e46-a468-a27009a95026 tempest-ProjectMemberTests-584998297 None] Lock "cinder-802bbb47-e245-448a-98e4-eaf9fc400a4d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d39b1a95-cb4d-4e46-a468-a27009a95026 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-802bbb47-e245-448a-98e4-eaf9fc400a4d" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d39b1a95-cb4d-4e46-a468-a27009a95026 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-802bbb47-e245-448a-98e4-eaf9fc400a4d" acquired by "delete_volume" :: waited 0.047s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:40 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[08aeeae8-bf64-4de1-9044-00ddd29fcd40]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d39b1a95-cb4d-4e46-a468-a27009a95026 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:41 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d Sep 28 17:29:41 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:41 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d39b1a95-cb4d-4e46-a468-a27009a95026 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d" returned: 0 in 0.896s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d39b1a95-cb4d-4e46-a468-a27009a95026 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:41 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d Sep 28 17:29:41 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:42 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Flow 'volume_create_manager' (3bc88f96-71b6-44e3-9abe-5bb9b982cfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:42 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3462778c-8e60-44af-9a8b-952592f78064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d39b1a95-cb4d-4e46-a468-a27009a95026 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-802bbb47-e245-448a-98e4-eaf9fc400a4d" returned: 0 in 0.783s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3462778c-8e60-44af-9a8b-952592f78064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1305604297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=316fff49-dba6-43b5-bceb-ac3d72f48611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee783b4cdea4e6cb2ac1f9c16155c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:42Z,use_quota=True,user_id='f7158827c0994f1ba079ebdc19eadcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (336e81f9-6c1b-48bb-8aa3-31d7a3f6c59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (336e81f9-6c1b-48bb-8aa3-31d7a3f6c59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a431741-183a-488b-97cb-8742982c5e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a431741-183a-488b-97cb-8742982c5e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '316fff49-dba6-43b5-bceb-ac3d72f48611', 'volume_name': 'volume-316fff49-dba6-43b5-bceb-ac3d72f48611', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e8a64b-b7db-4fef-bb05-d1de593bf9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e8a64b-b7db-4fef-bb05-d1de593bf9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:42 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52341138-fc02-46a6-a440-a37f15af2108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:42 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Volume 316fff49-dba6-43b5-bceb-ac3d72f48611: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-316fff49-dba6-43b5-bceb-ac3d72f48611', 'volume_size': 1} Sep 28 17:29:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d39b1a95-cb4d-4e46-a468-a27009a95026 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-802bbb47-e245-448a-98e4-eaf9fc400a4d" released by "delete_volume" :: held 1.936s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:42 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-d39b1a95-cb4d-4e46-a468-a27009a95026 tempest-ProjectMemberTests-584998297 None] Created reservations ['5b7dd5bc-5345-47bd-b67b-9fce5ca3efae', '57182263-b4aa-489e-b8af-f1251e6692a7', '550b3200-4ac5-4fdc-bb30-01e6dad4802f', '66a51d63-34f4-4450-a7e9-8e5e273844ce'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d39b1a95-cb4d-4e46-a468-a27009a95026 tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d39b1a95-cb4d-4e46-a468-a27009a95026 tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d39b1a95-cb4d-4e46-a468-a27009a95026 tempest-ProjectMemberTests-584998297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:42 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d39b1a95-cb4d-4e46-a468-a27009a95026 tempest-ProjectMemberTests-584998297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d39b1a95-cb4d-4e46-a468-a27009a95026 tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d39b1a95-cb4d-4e46-a468-a27009a95026 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:42 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:42 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:43 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d39b1a95-cb4d-4e46-a468-a27009a95026 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.533s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:43 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-d39b1a95-cb4d-4e46-a468-a27009a95026 tempest-ProjectMemberTests-584998297 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:43 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d39b1a95-cb4d-4e46-a468-a27009a95026 tempest-ProjectMemberTests-584998297 None] Deleted volume successfully. Sep 28 17:29:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d39b1a95-cb4d-4e46-a468-a27009a95026 tempest-ProjectMemberTests-584998297 None] Lock "cinder-802bbb47-e245-448a-98e4-eaf9fc400a4d-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:44 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Flow 'volume_create_manager' (2ff43a4c-efa2-4a94-bb97-b7012cd03b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7fb035-624c-433d-b4ff-ae7655ebcae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7fb035-624c-433d-b4ff-ae7655ebcae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1435383197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5740502-2a1b-4926-a0fd-6e6666485ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716b289f0179458f8e2e869e7ff71485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:44Z,use_quota=True,user_id='ccaca5bfad8b4b96b2ae3b66012f813b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f375eaee-92bc-48f7-ab73-6e1055eba4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f375eaee-92bc-48f7-ab73-6e1055eba4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7116f2e4-c967-4732-9aa3-4fd68ca85c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7116f2e4-c967-4732-9aa3-4fd68ca85c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5740502-2a1b-4926-a0fd-6e6666485ab4', 'volume_name': 'volume-f5740502-2a1b-4926-a0fd-6e6666485ab4', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ffce8c-cec2-4074-9b56-1f26e781c5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ffce8c-cec2-4074-9b56-1f26e781c5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:44 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea4b9417-c660-482c-9455-f4fc803ef5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:44 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Volume f5740502-2a1b-4926-a0fd-6e6666485ab4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5740502-2a1b-4926-a0fd-6e6666485ab4', 'volume_size': 1} Sep 28 17:29:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:46 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9434c098-e6d4-480d-98fd-7e1d51e728ea" returned: 0 in 8.822s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:46 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Image conversion details: src /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4, size 1024.00 MB, duration 8.82 sec, destination /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9434c098-e6d4-480d-98fd-7e1d51e728ea {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:29:46 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Converted 1024.00 MB image at 116.05 MB/s Sep 28 17:29:46 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9434c098-e6d4-480d-98fd-7e1d51e728ea is being set with open permissions: ugo+rw Sep 28 17:29:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9434c098-e6d4-480d-98fd-7e1d51e728ea {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:46 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9434c098-e6d4-480d-98fd-7e1d51e728ea Sep 28 17:29:46 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:46 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9434c098-e6d4-480d-98fd-7e1d51e728ea" returned: 0 in 0.267s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:46 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Lock "cinder-quobyte-9434c098-e6d4-480d-98fd-7e1d51e728ea" released by "_copy_volume_from_snapshot" :: held 10.320s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:46 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Lock "cinder-quobyte-f377596a-405f-46ae-a3ab-15e3b64da6c5-9434c098-e6d4-480d-98fd-7e1d51e728ea" released by "_create_volume_from_snapshot" :: held 10.396s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.440s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.313s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1305604297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=316fff49-dba6-43b5-bceb-ac3d72f48611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee783b4cdea4e6cb2ac1f9c16155c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:42Z,use_quota=True,user_id='f7158827c0994f1ba079ebdc19eadcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Creating volume 316fff49-dba6-43b5-bceb-ac3d72f48611 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:46 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:46 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:29:46 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:46 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611 1073741824 Sep 28 17:29:46 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef5f07d-8ad4-4865-b4ec-65bcf63b9fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9434c098-e6d4-480d-98fd-7e1d51e728ea', 'volume_size': 1, 'snapshot_id': 'f377596a-405f-46ae-a3ab-15e3b64da6c5'}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f27759df-80f9-4fee-ba1e-3cdb5a6cc2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:46 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Volume volume-9434c098-e6d4-480d-98fd-7e1d51e728ea (9434c098-e6d4-480d-98fd-7e1d51e728ea): created successfully Sep 28 17:29:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f27759df-80f9-4fee-ba1e-3cdb5a6cc2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:46 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Flow 'volume_create_manager' (d8925db3-e2b8-46ad-b3e1-073058608dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:46 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-8547f311-4cd2-45a8-963c-5b25bd8b929f tempest-VolumeDependencyTests-484233325 None] Created volume successfully. Sep 28 17:29:47 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611 1073741824" returned: 0 in 0.417s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:47 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611 Sep 28 17:29:47 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:47 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611" returned: 0 in 0.253s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.994s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1435383197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5740502-2a1b-4926-a0fd-6e6666485ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716b289f0179458f8e2e869e7ff71485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:44Z,use_quota=True,user_id='ccaca5bfad8b4b96b2ae3b66012f813b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Creating volume f5740502-2a1b-4926-a0fd-6e6666485ab4 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:47 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:47 devstack sudo[108491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4 1073741824 Sep 28 17:29:47 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52341138-fc02-46a6-a440-a37f15af2108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-316fff49-dba6-43b5-bceb-ac3d72f48611', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2f5e07-e542-4a30-8cc3-c433f0d32add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5665bfdc-ce18-41e0-ae79-64f10926be5f tempest-VolumeDependencyTests-484233325 None] Acquiring lock "cinder-f377596a-405f-46ae-a3ab-15e3b64da6c5-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:47 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Volume volume-316fff49-dba6-43b5-bceb-ac3d72f48611 (316fff49-dba6-43b5-bceb-ac3d72f48611): created successfully Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2f5e07-e542-4a30-8cc3-c433f0d32add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Flow 'volume_create_manager' (3bc88f96-71b6-44e3-9abe-5bb9b982cfab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5665bfdc-ce18-41e0-ae79-64f10926be5f tempest-VolumeDependencyTests-484233325 None] Lock "cinder-f377596a-405f-46ae-a3ab-15e3b64da6c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5665bfdc-ce18-41e0-ae79-64f10926be5f tempest-VolumeDependencyTests-484233325 None] Acquiring lock "cinder-quobyte-4dc4e516-56fc-47da-82ba-d53df5aca3f4" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:47 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-c5725ea5-77d0-47f7-9609-11207b45ad46 tempest-ProjectReaderTests-948494610 None] Created volume successfully. Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5665bfdc-ce18-41e0-ae79-64f10926be5f tempest-VolumeDependencyTests-484233325 None] Lock "cinder-quobyte-4dc4e516-56fc-47da-82ba-d53df5aca3f4" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5665bfdc-ce18-41e0-ae79-64f10926be5f tempest-VolumeDependencyTests-484233325 None] Acquiring lock "cinder-quobyte-f377596a-405f-46ae-a3ab-15e3b64da6c5" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5665bfdc-ce18-41e0-ae79-64f10926be5f tempest-VolumeDependencyTests-484233325 None] Lock "cinder-quobyte-f377596a-405f-46ae-a3ab-15e3b64da6c5" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-5665bfdc-ce18-41e0-ae79-64f10926be5f tempest-VolumeDependencyTests-484233325 None] Deleting offline snapshot f377596a-405f-46ae-a3ab-15e3b64da6c5 of volume 4dc4e516-56fc-47da-82ba-d53df5aca3f4 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-5665bfdc-ce18-41e0-ae79-64f10926be5f tempest-VolumeDependencyTests-484233325 None] snapshot_file for this snap is: volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[481feec5-67bf-4f8f-b3fe-4c3d54a7a2b9]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:47 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5665bfdc-ce18-41e0-ae79-64f10926be5f tempest-VolumeDependencyTests-484233325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:47 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5 Sep 28 17:29:47 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:48 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4 1073741824" returned: 0 in 0.548s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-39cd96a0-5dfb-42dc-88ec-17593af5ed81 tempest-ProjectReaderTests-948494610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:48 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4 Sep 28 17:29:48 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:48 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5665bfdc-ce18-41e0-ae79-64f10926be5f tempest-VolumeDependencyTests-484233325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5" returned: 0 in 0.469s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:48 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-5665bfdc-ce18-41e0-ae79-64f10926be5f tempest-VolumeDependencyTests-484233325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:29:48 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20aff4c-5642-402d-9d5c-1b22cb19e140]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5665bfdc-ce18-41e0-ae79-64f10926be5f tempest-VolumeDependencyTests-484233325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:48 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 Sep 28 17:29:48 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:48 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4" returned: 0 in 0.261s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:48 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-39cd96a0-5dfb-42dc-88ec-17593af5ed81 tempest-ProjectReaderTests-948494610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.297s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea4b9417-c660-482c-9455-f4fc803ef5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5740502-2a1b-4926-a0fd-6e6666485ab4', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277c0f74-4cdf-4dbc-8fbd-594de7cf5170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:48 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-39cd96a0-5dfb-42dc-88ec-17593af5ed81 tempest-ProjectReaderTests-948494610 None] Creating offline snapshot 3c23b8e2-8606-48aa-9566-b48d6eab4bbe of volume 316fff49-dba6-43b5-bceb-ac3d72f48611 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:29:48 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Volume volume-f5740502-2a1b-4926-a0fd-6e6666485ab4 (f5740502-2a1b-4926-a0fd-6e6666485ab4): created successfully Sep 28 17:29:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277c0f74-4cdf-4dbc-8fbd-594de7cf5170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:48 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Flow 'volume_create_manager' (2ff43a4c-efa2-4a94-bb97-b7012cd03b51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:48 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd74603-a48b-4dd2-9da6-cdf7f22578d6]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-39cd96a0-5dfb-42dc-88ec-17593af5ed81 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:48 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-0aaf71dd-a66b-4d2f-a5af-316c47572bca tempest-ProjectMemberTests-584998297 None] Created volume successfully. Sep 28 17:29:48 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611 Sep 28 17:29:48 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:48 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5665bfdc-ce18-41e0-ae79-64f10926be5f tempest-VolumeDependencyTests-484233325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4" returned: 0 in 0.553s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5665bfdc-ce18-41e0-ae79-64f10926be5f tempest-VolumeDependencyTests-484233325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:48 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5 Sep 28 17:29:48 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:48 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-39cd96a0-5dfb-42dc-88ec-17593af5ed81 tempest-ProjectReaderTests-948494610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611" returned: 0 in 0.398s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:48 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-39cd96a0-5dfb-42dc-88ec-17593af5ed81 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.3c23b8e2-8606-48aa-9566-b48d6eab4bbe 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:48 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.3c23b8e2-8606-48aa-9566-b48d6eab4bbe 1G Sep 28 17:29:48 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:49 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5665bfdc-ce18-41e0-ae79-64f10926be5f tempest-VolumeDependencyTests-484233325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5" returned: 0 in 0.412s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5665bfdc-ce18-41e0-ae79-64f10926be5f tempest-VolumeDependencyTests-484233325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:49 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5 Sep 28 17:29:49 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:49 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-39cd96a0-5dfb-42dc-88ec-17593af5ed81 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.3c23b8e2-8606-48aa-9566-b48d6eab4bbe 1G" returned: 0 in 0.439s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-39cd96a0-5dfb-42dc-88ec-17593af5ed81 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-316fff49-dba6-43b5-bceb-ac3d72f48611 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.3c23b8e2-8606-48aa-9566-b48d6eab4bbe {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:49 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-316fff49-dba6-43b5-bceb-ac3d72f48611 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.3c23b8e2-8606-48aa-9566-b48d6eab4bbe Sep 28 17:29:49 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:49 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5665bfdc-ce18-41e0-ae79-64f10926be5f tempest-VolumeDependencyTests-484233325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4.f377596a-405f-46ae-a3ab-15e3b64da6c5" returned: 0 in 0.282s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:49 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5665bfdc-ce18-41e0-ae79-64f10926be5f tempest-VolumeDependencyTests-484233325 None] Lock "cinder-quobyte-f377596a-405f-46ae-a3ab-15e3b64da6c5" released by "_delete_snapshot" :: held 1.848s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:49 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5665bfdc-ce18-41e0-ae79-64f10926be5f tempest-VolumeDependencyTests-484233325 None] Lock "cinder-quobyte-4dc4e516-56fc-47da-82ba-d53df5aca3f4" released by "delete_snapshot" :: held 1.884s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:49 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-39cd96a0-5dfb-42dc-88ec-17593af5ed81 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-316fff49-dba6-43b5-bceb-ac3d72f48611 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.3c23b8e2-8606-48aa-9566-b48d6eab4bbe" returned: 0 in 0.324s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:49 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-39cd96a0-5dfb-42dc-88ec-17593af5ed81 tempest-ProjectReaderTests-948494610 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.3c23b8e2-8606-48aa-9566-b48d6eab4bbe is being set with open permissions: ugo+rw Sep 28 17:29:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-39cd96a0-5dfb-42dc-88ec-17593af5ed81 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.3c23b8e2-8606-48aa-9566-b48d6eab4bbe {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:49 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-5665bfdc-ce18-41e0-ae79-64f10926be5f tempest-VolumeDependencyTests-484233325 None] Created reservations ['a1d1725c-4c2e-4588-920a-92a75b0c97ad', '942c8ae1-2014-4eca-b02f-874a3b36a3eb', 'c3f1f04d-3064-4c1d-a9a1-30275eca8b64', 'f017b77b-fdc0-449a-9029-e586d1513528'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:49 devstack sudo[108536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.3c23b8e2-8606-48aa-9566-b48d6eab4bbe Sep 28 17:29:49 devstack sudo[108536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:49 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-5665bfdc-ce18-41e0-ae79-64f10926be5f tempest-VolumeDependencyTests-484233325 None] Delete snapshot completed successfully. Sep 28 17:29:49 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-5665bfdc-ce18-41e0-ae79-64f10926be5f tempest-VolumeDependencyTests-484233325 None] Lock "cinder-f377596a-405f-46ae-a3ab-15e3b64da6c5-delete_snapshot" released by "delete_snapshot" :: held 2.159s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b1cc9b9f-fcea-4c55-93c6-048a3d55ee05 tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:49 devstack sudo[108536]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:49 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-39cd96a0-5dfb-42dc-88ec-17593af5ed81 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.3c23b8e2-8606-48aa-9566-b48d6eab4bbe" returned: 0 in 0.320s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-39cd96a0-5dfb-42dc-88ec-17593af5ed81 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:50 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.info Sep 28 17:29:50 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:50 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-39cd96a0-5dfb-42dc-88ec-17593af5ed81 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.info" returned: 0 in 0.276s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:50 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-39cd96a0-5dfb-42dc-88ec-17593af5ed81 tempest-ProjectReaderTests-948494610 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.info is being set with open permissions: ugo+rw Sep 28 17:29:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-39cd96a0-5dfb-42dc-88ec-17593af5ed81 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:50 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.info Sep 28 17:29:50 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:50 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-39cd96a0-5dfb-42dc-88ec-17593af5ed81 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.info" returned: 0 in 0.268s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-39cd96a0-5dfb-42dc-88ec-17593af5ed81 tempest-ProjectReaderTests-948494610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.141s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b1cc9b9f-fcea-4c55-93c6-048a3d55ee05 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.732s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:50 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-b1cc9b9f-fcea-4c55-93c6-048a3d55ee05 tempest-ProjectMemberTests-584998297 None] Creating offline snapshot 834da90e-0eff-48ee-9740-37b49e24361d of volume f5740502-2a1b-4926-a0fd-6e6666485ab4 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:29:50 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-39cd96a0-5dfb-42dc-88ec-17593af5ed81 tempest-ProjectReaderTests-948494610 None] Create snapshot completed successfully Sep 28 17:29:50 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3f3feb-bc54-49df-866a-7070677292f0]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:50 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b1cc9b9f-fcea-4c55-93c6-048a3d55ee05 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:50 devstack sudo[108545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4 Sep 28 17:29:50 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:50 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-07b0f73d-0968-4069-8f40-dcf4766e7260 tempest-VolumeDependencyTests-484233325 None] Acquiring lock "cinder-4dc4e516-56fc-47da-82ba-d53df5aca3f4-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:50 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-07b0f73d-0968-4069-8f40-dcf4766e7260 tempest-VolumeDependencyTests-484233325 None] Lock "cinder-4dc4e516-56fc-47da-82ba-d53df5aca3f4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:50 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-07b0f73d-0968-4069-8f40-dcf4766e7260 tempest-VolumeDependencyTests-484233325 None] Acquiring lock "cinder-quobyte-4dc4e516-56fc-47da-82ba-d53df5aca3f4" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:50 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-07b0f73d-0968-4069-8f40-dcf4766e7260 tempest-VolumeDependencyTests-484233325 None] Lock "cinder-quobyte-4dc4e516-56fc-47da-82ba-d53df5aca3f4" acquired by "delete_volume" :: waited 0.017s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5678cd-5e5d-432a-9bea-1524412d4ad5]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-07b0f73d-0968-4069-8f40-dcf4766e7260 tempest-VolumeDependencyTests-484233325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:51 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b1cc9b9f-fcea-4c55-93c6-048a3d55ee05 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4" returned: 0 in 0.430s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b1cc9b9f-fcea-4c55-93c6-048a3d55ee05 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.834da90e-0eff-48ee-9740-37b49e24361d 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:51 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.834da90e-0eff-48ee-9740-37b49e24361d 1G Sep 28 17:29:51 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:51 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 Sep 28 17:29:51 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:51 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-07b0f73d-0968-4069-8f40-dcf4766e7260 tempest-VolumeDependencyTests-484233325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4" returned: 0 in 0.424s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-07b0f73d-0968-4069-8f40-dcf4766e7260 tempest-VolumeDependencyTests-484233325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:51 devstack sudo[108560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4 Sep 28 17:29:51 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4ad963bb-6460-480c-b0cf-fa07eb31d53b tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-3c23b8e2-8606-48aa-9566-b48d6eab4bbe-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:51 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b1cc9b9f-fcea-4c55-93c6-048a3d55ee05 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.834da90e-0eff-48ee-9740-37b49e24361d 1G" returned: 0 in 0.526s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b1cc9b9f-fcea-4c55-93c6-048a3d55ee05 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5740502-2a1b-4926-a0fd-6e6666485ab4 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.834da90e-0eff-48ee-9740-37b49e24361d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:51 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5740502-2a1b-4926-a0fd-6e6666485ab4 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.834da90e-0eff-48ee-9740-37b49e24361d Sep 28 17:29:51 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4ad963bb-6460-480c-b0cf-fa07eb31d53b tempest-ProjectReaderTests-948494610 None] Lock "cinder-3c23b8e2-8606-48aa-9566-b48d6eab4bbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4ad963bb-6460-480c-b0cf-fa07eb31d53b tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-quobyte-316fff49-dba6-43b5-bceb-ac3d72f48611" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4ad963bb-6460-480c-b0cf-fa07eb31d53b tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-316fff49-dba6-43b5-bceb-ac3d72f48611" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4ad963bb-6460-480c-b0cf-fa07eb31d53b tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-quobyte-3c23b8e2-8606-48aa-9566-b48d6eab4bbe" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4ad963bb-6460-480c-b0cf-fa07eb31d53b tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-3c23b8e2-8606-48aa-9566-b48d6eab4bbe" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-4ad963bb-6460-480c-b0cf-fa07eb31d53b tempest-ProjectReaderTests-948494610 None] Deleting offline snapshot 3c23b8e2-8606-48aa-9566-b48d6eab4bbe of volume 316fff49-dba6-43b5-bceb-ac3d72f48611 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-4ad963bb-6460-480c-b0cf-fa07eb31d53b tempest-ProjectReaderTests-948494610 None] snapshot_file for this snap is: volume-316fff49-dba6-43b5-bceb-ac3d72f48611.3c23b8e2-8606-48aa-9566-b48d6eab4bbe {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[424cc18c-c823-48e7-98a6-6c4f15ec33b1]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4ad963bb-6460-480c-b0cf-fa07eb31d53b tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.3c23b8e2-8606-48aa-9566-b48d6eab4bbe {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:51 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-07b0f73d-0968-4069-8f40-dcf4766e7260 tempest-VolumeDependencyTests-484233325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-4dc4e516-56fc-47da-82ba-d53df5aca3f4" returned: 0 in 0.322s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-07b0f73d-0968-4069-8f40-dcf4766e7260 tempest-VolumeDependencyTests-484233325 None] Lock "cinder-quobyte-4dc4e516-56fc-47da-82ba-d53df5aca3f4" released by "delete_volume" :: held 0.834s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-07b0f73d-0968-4069-8f40-dcf4766e7260 tempest-VolumeDependencyTests-484233325 None] Created reservations ['8b20f0cb-1841-451a-9e3d-369545c13821', 'e0f3b545-d557-4494-a281-2c6ea835183e', 'd70dabca-91d3-479a-a124-920253add4f7', '93bde7c4-0f4d-4cfc-8c86-67d13c1fb08b'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:51 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.3c23b8e2-8606-48aa-9566-b48d6eab4bbe Sep 28 17:29:51 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-07b0f73d-0968-4069-8f40-dcf4766e7260 tempest-VolumeDependencyTests-484233325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-07b0f73d-0968-4069-8f40-dcf4766e7260 tempest-VolumeDependencyTests-484233325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-07b0f73d-0968-4069-8f40-dcf4766e7260 tempest-VolumeDependencyTests-484233325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-07b0f73d-0968-4069-8f40-dcf4766e7260 tempest-VolumeDependencyTests-484233325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-07b0f73d-0968-4069-8f40-dcf4766e7260 tempest-VolumeDependencyTests-484233325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:51 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-07b0f73d-0968-4069-8f40-dcf4766e7260 tempest-VolumeDependencyTests-484233325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:52 devstack sudo[108572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:52 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:52 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b1cc9b9f-fcea-4c55-93c6-048a3d55ee05 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5740502-2a1b-4926-a0fd-6e6666485ab4 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.834da90e-0eff-48ee-9740-37b49e24361d" returned: 0 in 0.421s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:52 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-b1cc9b9f-fcea-4c55-93c6-048a3d55ee05 tempest-ProjectMemberTests-584998297 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.834da90e-0eff-48ee-9740-37b49e24361d is being set with open permissions: ugo+rw Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b1cc9b9f-fcea-4c55-93c6-048a3d55ee05 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.834da90e-0eff-48ee-9740-37b49e24361d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:52 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.834da90e-0eff-48ee-9740-37b49e24361d Sep 28 17:29:52 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-aa564278-3d94-4a44-a50c-38f221d8c8c7 tempest-VolumeDependencyTests-484233325 None] Acquiring lock "cinder-9434c098-e6d4-480d-98fd-7e1d51e728ea-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-aa564278-3d94-4a44-a50c-38f221d8c8c7 tempest-VolumeDependencyTests-484233325 None] Lock "cinder-9434c098-e6d4-480d-98fd-7e1d51e728ea-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-aa564278-3d94-4a44-a50c-38f221d8c8c7 tempest-VolumeDependencyTests-484233325 None] Acquiring lock "cinder-quobyte-9434c098-e6d4-480d-98fd-7e1d51e728ea" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-aa564278-3d94-4a44-a50c-38f221d8c8c7 tempest-VolumeDependencyTests-484233325 None] Lock "cinder-quobyte-9434c098-e6d4-480d-98fd-7e1d51e728ea" acquired by "delete_volume" :: waited 0.021s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e477bf1-fdf5-485f-8f1d-711ca7419edf]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa564278-3d94-4a44-a50c-38f221d8c8c7 tempest-VolumeDependencyTests-484233325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9434c098-e6d4-480d-98fd-7e1d51e728ea {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:52 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4ad963bb-6460-480c-b0cf-fa07eb31d53b tempest-ProjectReaderTests-948494610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.3c23b8e2-8606-48aa-9566-b48d6eab4bbe" returned: 0 in 0.602s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-4ad963bb-6460-480c-b0cf-fa07eb31d53b tempest-ProjectReaderTests-948494610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-316fff49-dba6-43b5-bceb-ac3d72f48611(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:29:52 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:52 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-07b0f73d-0968-4069-8f40-dcf4766e7260 tempest-VolumeDependencyTests-484233325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.390s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b1cc9b9f-fcea-4c55-93c6-048a3d55ee05 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.834da90e-0eff-48ee-9740-37b49e24361d" returned: 0 in 0.336s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-07b0f73d-0968-4069-8f40-dcf4766e7260 tempest-VolumeDependencyTests-484233325 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d84c2b-5be5-4ae2-af7d-0a4bec84a1be]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:52 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-07b0f73d-0968-4069-8f40-dcf4766e7260 tempest-VolumeDependencyTests-484233325 None] Deleted volume successfully. Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4ad963bb-6460-480c-b0cf-fa07eb31d53b tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:52 devstack sudo[108579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9434c098-e6d4-480d-98fd-7e1d51e728ea Sep 28 17:29:52 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b1cc9b9f-fcea-4c55-93c6-048a3d55ee05 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-07b0f73d-0968-4069-8f40-dcf4766e7260 tempest-VolumeDependencyTests-484233325 None] Lock "cinder-4dc4e516-56fc-47da-82ba-d53df5aca3f4-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:52 devstack sudo[108584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.info Sep 28 17:29:52 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:52 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611 Sep 28 17:29:52 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:52 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa564278-3d94-4a44-a50c-38f221d8c8c7 tempest-VolumeDependencyTests-484233325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9434c098-e6d4-480d-98fd-7e1d51e728ea" returned: 0 in 0.481s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa564278-3d94-4a44-a50c-38f221d8c8c7 tempest-VolumeDependencyTests-484233325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9434c098-e6d4-480d-98fd-7e1d51e728ea {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:52 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9434c098-e6d4-480d-98fd-7e1d51e728ea Sep 28 17:29:52 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:52 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b1cc9b9f-fcea-4c55-93c6-048a3d55ee05 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.info" returned: 0 in 0.356s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:52 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-b1cc9b9f-fcea-4c55-93c6-048a3d55ee05 tempest-ProjectMemberTests-584998297 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.info is being set with open permissions: ugo+rw Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b1cc9b9f-fcea-4c55-93c6-048a3d55ee05 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:52 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.info Sep 28 17:29:52 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:52 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4ad963bb-6460-480c-b0cf-fa07eb31d53b tempest-ProjectReaderTests-948494610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611" returned: 0 in 0.463s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:52 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4ad963bb-6460-480c-b0cf-fa07eb31d53b tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.3c23b8e2-8606-48aa-9566-b48d6eab4bbe {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:52 devstack sudo[108599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.3c23b8e2-8606-48aa-9566-b48d6eab4bbe Sep 28 17:29:52 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:53 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa564278-3d94-4a44-a50c-38f221d8c8c7 tempest-VolumeDependencyTests-484233325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9434c098-e6d4-480d-98fd-7e1d51e728ea" returned: 0 in 0.317s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-aa564278-3d94-4a44-a50c-38f221d8c8c7 tempest-VolumeDependencyTests-484233325 None] Lock "cinder-quobyte-9434c098-e6d4-480d-98fd-7e1d51e728ea" released by "delete_volume" :: held 0.852s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:53 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-b1cc9b9f-fcea-4c55-93c6-048a3d55ee05 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.info" returned: 0 in 0.305s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-b1cc9b9f-fcea-4c55-93c6-048a3d55ee05 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.533s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:53 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-b1cc9b9f-fcea-4c55-93c6-048a3d55ee05 tempest-ProjectMemberTests-584998297 None] Create snapshot completed successfully Sep 28 17:29:53 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-aa564278-3d94-4a44-a50c-38f221d8c8c7 tempest-VolumeDependencyTests-484233325 None] Created reservations ['025071b1-327a-4ab9-81c2-6a57e8bc3ff5', 'a104ff58-ab39-44de-abdd-489b4d325bbf', 'd4a98209-7065-4138-979c-0d26cf73bde0', '9deec33d-8051-4209-a827-d94d752225f0'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-aa564278-3d94-4a44-a50c-38f221d8c8c7 tempest-VolumeDependencyTests-484233325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-aa564278-3d94-4a44-a50c-38f221d8c8c7 tempest-VolumeDependencyTests-484233325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-aa564278-3d94-4a44-a50c-38f221d8c8c7 tempest-VolumeDependencyTests-484233325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:53 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-aa564278-3d94-4a44-a50c-38f221d8c8c7 tempest-VolumeDependencyTests-484233325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-aa564278-3d94-4a44-a50c-38f221d8c8c7 tempest-VolumeDependencyTests-484233325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa564278-3d94-4a44-a50c-38f221d8c8c7 tempest-VolumeDependencyTests-484233325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:53 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:53 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4ad963bb-6460-480c-b0cf-fa07eb31d53b tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.3c23b8e2-8606-48aa-9566-b48d6eab4bbe" returned: 0 in 0.479s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:53 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4ad963bb-6460-480c-b0cf-fa07eb31d53b tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.3c23b8e2-8606-48aa-9566-b48d6eab4bbe {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:53 devstack sudo[108609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.3c23b8e2-8606-48aa-9566-b48d6eab4bbe Sep 28 17:29:53 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:53 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aa564278-3d94-4a44-a50c-38f221d8c8c7 tempest-VolumeDependencyTests-484233325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.288s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:53 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-aa564278-3d94-4a44-a50c-38f221d8c8c7 tempest-VolumeDependencyTests-484233325 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:53 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-aa564278-3d94-4a44-a50c-38f221d8c8c7 tempest-VolumeDependencyTests-484233325 None] Deleted volume successfully. Sep 28 17:29:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-aa564278-3d94-4a44-a50c-38f221d8c8c7 tempest-VolumeDependencyTests-484233325 None] Lock "cinder-9434c098-e6d4-480d-98fd-7e1d51e728ea-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:53 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:53 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4ad963bb-6460-480c-b0cf-fa07eb31d53b tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611.3c23b8e2-8606-48aa-9566-b48d6eab4bbe" returned: 0 in 0.323s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4ad963bb-6460-480c-b0cf-fa07eb31d53b tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-3c23b8e2-8606-48aa-9566-b48d6eab4bbe" released by "_delete_snapshot" :: held 2.005s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4ad963bb-6460-480c-b0cf-fa07eb31d53b tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-316fff49-dba6-43b5-bceb-ac3d72f48611" released by "delete_snapshot" :: held 2.030s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:53 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-4ad963bb-6460-480c-b0cf-fa07eb31d53b tempest-ProjectReaderTests-948494610 None] Created reservations ['05a85e1a-1658-4b2c-961b-ed8264439229', '367ff690-98af-4adf-843c-63c6c8110409', 'c9e1ce63-ecf2-4a57-8dd9-ead41c48dacc', 'e444cee8-923c-4511-b5f7-748e1848de85'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:53 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-4ad963bb-6460-480c-b0cf-fa07eb31d53b tempest-ProjectReaderTests-948494610 None] Delete snapshot completed successfully. Sep 28 17:29:53 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4ad963bb-6460-480c-b0cf-fa07eb31d53b tempest-ProjectReaderTests-948494610 None] Lock "cinder-3c23b8e2-8606-48aa-9566-b48d6eab4bbe-delete_snapshot" released by "delete_snapshot" :: held 2.197s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:54 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-6b001196-8558-496c-b7d3-62be19b1b446 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-834da90e-0eff-48ee-9740-37b49e24361d-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:54 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-6b001196-8558-496c-b7d3-62be19b1b446 tempest-ProjectMemberTests-584998297 None] Lock "cinder-834da90e-0eff-48ee-9740-37b49e24361d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:54 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-6b001196-8558-496c-b7d3-62be19b1b446 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-f5740502-2a1b-4926-a0fd-6e6666485ab4" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:54 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-6b001196-8558-496c-b7d3-62be19b1b446 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-f5740502-2a1b-4926-a0fd-6e6666485ab4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:54 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-6b001196-8558-496c-b7d3-62be19b1b446 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-834da90e-0eff-48ee-9740-37b49e24361d" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:54 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-6b001196-8558-496c-b7d3-62be19b1b446 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-834da90e-0eff-48ee-9740-37b49e24361d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:54 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-6b001196-8558-496c-b7d3-62be19b1b446 tempest-ProjectMemberTests-584998297 None] Deleting offline snapshot 834da90e-0eff-48ee-9740-37b49e24361d of volume f5740502-2a1b-4926-a0fd-6e6666485ab4 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:29:54 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-6b001196-8558-496c-b7d3-62be19b1b446 tempest-ProjectMemberTests-584998297 None] snapshot_file for this snap is: volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.834da90e-0eff-48ee-9740-37b49e24361d {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:29:54 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa6fff6-9da8-4636-966f-46f3fc0adcb1]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6b001196-8558-496c-b7d3-62be19b1b446 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.834da90e-0eff-48ee-9740-37b49e24361d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:54 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.834da90e-0eff-48ee-9740-37b49e24361d Sep 28 17:29:54 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:54 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6b001196-8558-496c-b7d3-62be19b1b446 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.834da90e-0eff-48ee-9740-37b49e24361d" returned: 0 in 0.442s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:54 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-6b001196-8558-496c-b7d3-62be19b1b446 tempest-ProjectMemberTests-584998297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5740502-2a1b-4926-a0fd-6e6666485ab4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:29:54 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2c4aaf-0eb2-471c-af88-9a1d2266c3a0]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:54 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6b001196-8558-496c-b7d3-62be19b1b446 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:54 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-061d302c-80e8-43eb-b41b-909ac860d584 tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-316fff49-dba6-43b5-bceb-ac3d72f48611-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:54 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-061d302c-80e8-43eb-b41b-909ac860d584 tempest-ProjectReaderTests-948494610 None] Lock "cinder-316fff49-dba6-43b5-bceb-ac3d72f48611-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:54 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4 Sep 28 17:29:54 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:54 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-061d302c-80e8-43eb-b41b-909ac860d584 tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-quobyte-316fff49-dba6-43b5-bceb-ac3d72f48611" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:54 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-061d302c-80e8-43eb-b41b-909ac860d584 tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-316fff49-dba6-43b5-bceb-ac3d72f48611" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:55 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[48145934-4912-4a34-aac7-9630fafaa19b]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-061d302c-80e8-43eb-b41b-909ac860d584 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:55 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611 Sep 28 17:29:55 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:55 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6b001196-8558-496c-b7d3-62be19b1b446 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4" returned: 0 in 0.496s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6b001196-8558-496c-b7d3-62be19b1b446 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.834da90e-0eff-48ee-9740-37b49e24361d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:55 devstack sudo[108626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.834da90e-0eff-48ee-9740-37b49e24361d Sep 28 17:29:55 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:55 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-061d302c-80e8-43eb-b41b-909ac860d584 tempest-ProjectReaderTests-948494610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611" returned: 0 in 0.530s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-061d302c-80e8-43eb-b41b-909ac860d584 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:55 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611 Sep 28 17:29:55 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:55 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6b001196-8558-496c-b7d3-62be19b1b446 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.834da90e-0eff-48ee-9740-37b49e24361d" returned: 0 in 0.461s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6b001196-8558-496c-b7d3-62be19b1b446 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.834da90e-0eff-48ee-9740-37b49e24361d {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:55 devstack sudo[108636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.834da90e-0eff-48ee-9740-37b49e24361d Sep 28 17:29:55 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:55 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:55 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-061d302c-80e8-43eb-b41b-909ac860d584 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-316fff49-dba6-43b5-bceb-ac3d72f48611" returned: 0 in 0.289s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:55 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-061d302c-80e8-43eb-b41b-909ac860d584 tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-316fff49-dba6-43b5-bceb-ac3d72f48611" released by "delete_volume" :: held 0.927s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:55 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-061d302c-80e8-43eb-b41b-909ac860d584 tempest-ProjectReaderTests-948494610 None] Created reservations ['09338e8a-9f62-4f58-a993-59e451dd4c1c', '791cb2c3-6acf-4071-b5e1-7453ebac6314', 'cb6bfa7e-098d-458f-a390-a2fe446db02c', 'bbb26c19-0817-4efc-ab40-d3184966b772'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-061d302c-80e8-43eb-b41b-909ac860d584 tempest-ProjectReaderTests-948494610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-061d302c-80e8-43eb-b41b-909ac860d584 tempest-ProjectReaderTests-948494610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:56 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-061d302c-80e8-43eb-b41b-909ac860d584 tempest-ProjectReaderTests-948494610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:56 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-061d302c-80e8-43eb-b41b-909ac860d584 tempest-ProjectReaderTests-948494610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-061d302c-80e8-43eb-b41b-909ac860d584 tempest-ProjectReaderTests-948494610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-061d302c-80e8-43eb-b41b-909ac860d584 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:56 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6b001196-8558-496c-b7d3-62be19b1b446 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4.834da90e-0eff-48ee-9740-37b49e24361d" returned: 0 in 0.355s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:56 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:56 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:56 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-6b001196-8558-496c-b7d3-62be19b1b446 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-834da90e-0eff-48ee-9740-37b49e24361d" released by "_delete_snapshot" :: held 1.927s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:56 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-6b001196-8558-496c-b7d3-62be19b1b446 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-f5740502-2a1b-4926-a0fd-6e6666485ab4" released by "delete_snapshot" :: held 1.952s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:56 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-6b001196-8558-496c-b7d3-62be19b1b446 tempest-ProjectMemberTests-584998297 None] Created reservations ['c93c1d8c-33ec-4910-8a27-4bbdb46c2513', '173bdd1a-60d5-4ca0-9a00-79a8020fb0a6', '7cd839bd-5e2f-420c-a2d6-81ffe765a1d4', 'd58a1526-a368-4574-bfd2-082080193540'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:56 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-6b001196-8558-496c-b7d3-62be19b1b446 tempest-ProjectMemberTests-584998297 None] Delete snapshot completed successfully. Sep 28 17:29:56 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-6b001196-8558-496c-b7d3-62be19b1b446 tempest-ProjectMemberTests-584998297 None] Lock "cinder-834da90e-0eff-48ee-9740-37b49e24361d-delete_snapshot" released by "delete_snapshot" :: held 2.120s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:56 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d4a8d7f2-b702-42f6-9aac-18810850990f tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-f5740502-2a1b-4926-a0fd-6e6666485ab4-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:56 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-061d302c-80e8-43eb-b41b-909ac860d584 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.306s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:56 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-061d302c-80e8-43eb-b41b-909ac860d584 tempest-ProjectReaderTests-948494610 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:56 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d4a8d7f2-b702-42f6-9aac-18810850990f tempest-ProjectMemberTests-584998297 None] Lock "cinder-f5740502-2a1b-4926-a0fd-6e6666485ab4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:56 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-061d302c-80e8-43eb-b41b-909ac860d584 tempest-ProjectReaderTests-948494610 None] Deleted volume successfully. Sep 28 17:29:56 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-061d302c-80e8-43eb-b41b-909ac860d584 tempest-ProjectReaderTests-948494610 None] Lock "cinder-316fff49-dba6-43b5-bceb-ac3d72f48611-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:56 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d4a8d7f2-b702-42f6-9aac-18810850990f tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-f5740502-2a1b-4926-a0fd-6e6666485ab4" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:56 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d4a8d7f2-b702-42f6-9aac-18810850990f tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-f5740502-2a1b-4926-a0fd-6e6666485ab4" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:56 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[913b60c7-4ea0-4322-8153-21e1f2cde66a]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d4a8d7f2-b702-42f6-9aac-18810850990f tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:56 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4 Sep 28 17:29:56 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:56 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d4a8d7f2-b702-42f6-9aac-18810850990f tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4" returned: 0 in 0.436s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:56 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d4a8d7f2-b702-42f6-9aac-18810850990f tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:56 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4 Sep 28 17:29:56 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:57 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d4a8d7f2-b702-42f6-9aac-18810850990f tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-f5740502-2a1b-4926-a0fd-6e6666485ab4" returned: 0 in 0.309s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d4a8d7f2-b702-42f6-9aac-18810850990f tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-f5740502-2a1b-4926-a0fd-6e6666485ab4" released by "delete_volume" :: held 0.837s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-d4a8d7f2-b702-42f6-9aac-18810850990f tempest-ProjectMemberTests-584998297 None] Created reservations ['96721e78-fa4b-486f-949a-c53531cc43e4', '3191a723-f7ac-453b-bfe9-d5ab43831ad0', 'c480dd13-6e80-43c5-96d0-127c16f498de', '7b9b3ef2-be8b-46a6-8357-4e4d90e2d9b9'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d4a8d7f2-b702-42f6-9aac-18810850990f tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d4a8d7f2-b702-42f6-9aac-18810850990f tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d4a8d7f2-b702-42f6-9aac-18810850990f tempest-ProjectMemberTests-584998297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d4a8d7f2-b702-42f6-9aac-18810850990f tempest-ProjectMemberTests-584998297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d4a8d7f2-b702-42f6-9aac-18810850990f tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d4a8d7f2-b702-42f6-9aac-18810850990f tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:57 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:29:57 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Flow 'volume_create_manager' (4ba11321-5ee7-451c-b7cf-d4cfdc739077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4045a84-e68a-43a3-87ba-b5cbcdba22d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4045a84-e68a-43a3-87ba-b5cbcdba22d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2146848976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3acd9be-28b6-4f4a-a151-95fbc4e379d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee783b4cdea4e6cb2ac1f9c16155c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:58Z,use_quota=True,user_id='f7158827c0994f1ba079ebdc19eadcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f4cee4-8df7-4aaa-95b8-060a6a275dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f4cee4-8df7-4aaa-95b8-060a6a275dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c80ae27f-1034-43e2-bdcd-a3da863ff0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c80ae27f-1034-43e2-bdcd-a3da863ff0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3acd9be-28b6-4f4a-a151-95fbc4e379d9', 'volume_name': 'volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (184b975a-b445-4d77-95bb-1335d9d3d394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (184b975a-b445-4d77-95bb-1335d9d3d394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:57 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4df64908-0598-408f-973b-b0a52b346aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:57 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Volume a3acd9be-28b6-4f4a-a151-95fbc4e379d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9', 'volume_size': 1} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2146848976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3acd9be-28b6-4f4a-a151-95fbc4e379d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee783b4cdea4e6cb2ac1f9c16155c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:58Z,use_quota=True,user_id='f7158827c0994f1ba079ebdc19eadcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Creating volume a3acd9be-28b6-4f4a-a151-95fbc4e379d9 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:57 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d4a8d7f2-b702-42f6-9aac-18810850990f tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.390s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-d4a8d7f2-b702-42f6-9aac-18810850990f tempest-ProjectMemberTests-584998297 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:57 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d4a8d7f2-b702-42f6-9aac-18810850990f tempest-ProjectMemberTests-584998297 None] Deleted volume successfully. Sep 28 17:29:57 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9 1073741824 Sep 28 17:29:57 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:57 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d4a8d7f2-b702-42f6-9aac-18810850990f tempest-ProjectMemberTests-584998297 None] Lock "cinder-f5740502-2a1b-4926-a0fd-6e6666485ab4-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Flow 'volume_create_manager' (9defb596-c601-4324-aeb2-cba6f2f4b0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e22db71-7960-4bdd-b19a-4e955e743712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e22db71-7960-4bdd-b19a-4e955e743712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-907979156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce53bbdc-6877-4e9b-be62-e6a65a930251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716b289f0179458f8e2e869e7ff71485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:58Z,use_quota=True,user_id='ccaca5bfad8b4b96b2ae3b66012f813b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff50b0e-07a1-4c5e-9f7e-ad3dcca6bc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff50b0e-07a1-4c5e-9f7e-ad3dcca6bc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9712f580-8f65-4471-850f-2885e408ba46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9712f580-8f65-4471-850f-2885e408ba46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce53bbdc-6877-4e9b-be62-e6a65a930251', 'volume_name': 'volume-ce53bbdc-6877-4e9b-be62-e6a65a930251', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afac168b-b403-4a44-a1fe-2839d45717e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afac168b-b403-4a44-a1fe-2839d45717e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d11d90-f6b5-42ae-859d-cecd08d458ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:58 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Volume ce53bbdc-6877-4e9b-be62-e6a65a930251: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce53bbdc-6877-4e9b-be62-e6a65a930251', 'volume_size': 1} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:58 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9 1073741824" returned: 0 in 0.620s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:58 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9 Sep 28 17:29:58 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:58 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9" returned: 0 in 0.289s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.471s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-907979156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce53bbdc-6877-4e9b-be62-e6a65a930251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716b289f0179458f8e2e869e7ff71485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:58Z,use_quota=True,user_id='ccaca5bfad8b4b96b2ae3b66012f813b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Creating volume ce53bbdc-6877-4e9b-be62-e6a65a930251 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:58 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4df64908-0598-408f-973b-b0a52b346aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:58 devstack sudo[108663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251 1073741824 Sep 28 17:29:58 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe53f83c-08ec-4227-a90c-e55014c4c74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:58 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Volume volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9 (a3acd9be-28b6-4f4a-a151-95fbc4e379d9): created successfully Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe53f83c-08ec-4227-a90c-e55014c4c74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:58 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Flow 'volume_create_manager' (4ba11321-5ee7-451c-b7cf-d4cfdc739077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:58 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-0478d361-7a11-4713-99c2-59b491e5dee3 tempest-ProjectReaderTests-948494610 None] Created volume successfully. Sep 28 17:29:59 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251 1073741824" returned: 0 in 0.466s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:59 devstack sudo[108669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251 Sep 28 17:29:59 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:59 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251" returned: 0 in 0.263s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d11d90-f6b5-42ae-859d-cecd08d458ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce53bbdc-6877-4e9b-be62-e6a65a930251', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb8ebfb-5314-4615-8b9a-d1600791760c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:59 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Volume volume-ce53bbdc-6877-4e9b-be62-e6a65a930251 (ce53bbdc-6877-4e9b-be62-e6a65a930251): created successfully Sep 28 17:29:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb8ebfb-5314-4615-8b9a-d1600791760c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Flow 'volume_create_manager' (9defb596-c601-4324-aeb2-cba6f2f4b0e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:59 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-5f3478b0-1327-49c9-b8d1-cdee12127a0b tempest-ProjectMemberTests-584998297 None] Created volume successfully. Sep 28 17:29:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4886566d-015d-4d98-a459-0403e30d4516 tempest-ProjectReaderTests-948494610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4886566d-015d-4d98-a459-0403e30d4516 tempest-ProjectReaderTests-948494610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-4886566d-015d-4d98-a459-0403e30d4516 tempest-ProjectReaderTests-948494610 None] Creating offline snapshot 3023871f-376b-4e6c-b06f-51b2d3e69bdb of volume a3acd9be-28b6-4f4a-a151-95fbc4e379d9 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:30:00 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cb86a3-96a7-494a-a0b5-a773abbff689]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4886566d-015d-4d98-a459-0403e30d4516 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:00 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9 Sep 28 17:30:00 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:00 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4886566d-015d-4d98-a459-0403e30d4516 tempest-ProjectReaderTests-948494610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9" returned: 0 in 0.481s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4886566d-015d-4d98-a459-0403e30d4516 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.3023871f-376b-4e6c-b06f-51b2d3e69bdb 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:00 devstack sudo[108678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.3023871f-376b-4e6c-b06f-51b2d3e69bdb 1G Sep 28 17:30:00 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-dfe3e7c2-0e48-4479-9755-bbfedb8175a0 tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:00 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4886566d-015d-4d98-a459-0403e30d4516 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.3023871f-376b-4e6c-b06f-51b2d3e69bdb 1G" returned: 0 in 0.412s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4886566d-015d-4d98-a459-0403e30d4516 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.3023871f-376b-4e6c-b06f-51b2d3e69bdb {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:00 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.3023871f-376b-4e6c-b06f-51b2d3e69bdb Sep 28 17:30:00 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:01 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4886566d-015d-4d98-a459-0403e30d4516 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.3023871f-376b-4e6c-b06f-51b2d3e69bdb" returned: 0 in 0.286s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:01 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-4886566d-015d-4d98-a459-0403e30d4516 tempest-ProjectReaderTests-948494610 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.3023871f-376b-4e6c-b06f-51b2d3e69bdb is being set with open permissions: ugo+rw Sep 28 17:30:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4886566d-015d-4d98-a459-0403e30d4516 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.3023871f-376b-4e6c-b06f-51b2d3e69bdb {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:01 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.3023871f-376b-4e6c-b06f-51b2d3e69bdb Sep 28 17:30:01 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:01 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4886566d-015d-4d98-a459-0403e30d4516 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.3023871f-376b-4e6c-b06f-51b2d3e69bdb" returned: 0 in 0.246s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4886566d-015d-4d98-a459-0403e30d4516 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:01 devstack sudo[108692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.info Sep 28 17:30:01 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:01 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4886566d-015d-4d98-a459-0403e30d4516 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.info" returned: 0 in 0.270s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:01 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-4886566d-015d-4d98-a459-0403e30d4516 tempest-ProjectReaderTests-948494610 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.info is being set with open permissions: ugo+rw Sep 28 17:30:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4886566d-015d-4d98-a459-0403e30d4516 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:01 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.info Sep 28 17:30:01 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:02 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4886566d-015d-4d98-a459-0403e30d4516 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.info" returned: 0 in 0.271s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4886566d-015d-4d98-a459-0403e30d4516 tempest-ProjectReaderTests-948494610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.077s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-dfe3e7c2-0e48-4479-9755-bbfedb8175a0 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.415s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-dfe3e7c2-0e48-4479-9755-bbfedb8175a0 tempest-ProjectMemberTests-584998297 None] Creating offline snapshot c9494dbe-6b15-4cf1-82f9-d66efbbc52e2 of volume ce53bbdc-6877-4e9b-be62-e6a65a930251 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:30:02 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-4886566d-015d-4d98-a459-0403e30d4516 tempest-ProjectReaderTests-948494610 None] Create snapshot completed successfully Sep 28 17:30:02 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[0887b969-6142-4320-af6c-6f41d9f4ccb4]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dfe3e7c2-0e48-4479-9755-bbfedb8175a0 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:02 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251 Sep 28 17:30:02 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:02 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dfe3e7c2-0e48-4479-9755-bbfedb8175a0 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251" returned: 0 in 0.434s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dfe3e7c2-0e48-4479-9755-bbfedb8175a0 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.c9494dbe-6b15-4cf1-82f9-d66efbbc52e2 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:02 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.c9494dbe-6b15-4cf1-82f9-d66efbbc52e2 1G Sep 28 17:30:02 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:02 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dfe3e7c2-0e48-4479-9755-bbfedb8175a0 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.c9494dbe-6b15-4cf1-82f9-d66efbbc52e2 1G" returned: 0 in 0.410s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dfe3e7c2-0e48-4479-9755-bbfedb8175a0 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce53bbdc-6877-4e9b-be62-e6a65a930251 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.c9494dbe-6b15-4cf1-82f9-d66efbbc52e2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:03 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce53bbdc-6877-4e9b-be62-e6a65a930251 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.c9494dbe-6b15-4cf1-82f9-d66efbbc52e2 Sep 28 17:30:03 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-62a5b02b-a8fe-4bd1-b9c4-10854949b1d9 tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-3023871f-376b-4e6c-b06f-51b2d3e69bdb-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-62a5b02b-a8fe-4bd1-b9c4-10854949b1d9 tempest-ProjectReaderTests-948494610 None] Lock "cinder-3023871f-376b-4e6c-b06f-51b2d3e69bdb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-62a5b02b-a8fe-4bd1-b9c4-10854949b1d9 tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-quobyte-a3acd9be-28b6-4f4a-a151-95fbc4e379d9" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-62a5b02b-a8fe-4bd1-b9c4-10854949b1d9 tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-a3acd9be-28b6-4f4a-a151-95fbc4e379d9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-62a5b02b-a8fe-4bd1-b9c4-10854949b1d9 tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-quobyte-3023871f-376b-4e6c-b06f-51b2d3e69bdb" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-62a5b02b-a8fe-4bd1-b9c4-10854949b1d9 tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-3023871f-376b-4e6c-b06f-51b2d3e69bdb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-62a5b02b-a8fe-4bd1-b9c4-10854949b1d9 tempest-ProjectReaderTests-948494610 None] Deleting offline snapshot 3023871f-376b-4e6c-b06f-51b2d3e69bdb of volume a3acd9be-28b6-4f4a-a151-95fbc4e379d9 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:30:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-62a5b02b-a8fe-4bd1-b9c4-10854949b1d9 tempest-ProjectReaderTests-948494610 None] snapshot_file for this snap is: volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.3023871f-376b-4e6c-b06f-51b2d3e69bdb {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:30:03 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb1248f-ebad-423a-9a19-85171d52b512]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62a5b02b-a8fe-4bd1-b9c4-10854949b1d9 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.3023871f-376b-4e6c-b06f-51b2d3e69bdb {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:03 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dfe3e7c2-0e48-4479-9755-bbfedb8175a0 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce53bbdc-6877-4e9b-be62-e6a65a930251 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.c9494dbe-6b15-4cf1-82f9-d66efbbc52e2" returned: 0 in 0.337s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:03 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-dfe3e7c2-0e48-4479-9755-bbfedb8175a0 tempest-ProjectMemberTests-584998297 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.c9494dbe-6b15-4cf1-82f9-d66efbbc52e2 is being set with open permissions: ugo+rw Sep 28 17:30:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dfe3e7c2-0e48-4479-9755-bbfedb8175a0 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.c9494dbe-6b15-4cf1-82f9-d66efbbc52e2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:03 devstack sudo[108716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.c9494dbe-6b15-4cf1-82f9-d66efbbc52e2 Sep 28 17:30:03 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:03 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.3023871f-376b-4e6c-b06f-51b2d3e69bdb Sep 28 17:30:03 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:03 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dfe3e7c2-0e48-4479-9755-bbfedb8175a0 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.c9494dbe-6b15-4cf1-82f9-d66efbbc52e2" returned: 0 in 0.319s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dfe3e7c2-0e48-4479-9755-bbfedb8175a0 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:03 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.info Sep 28 17:30:03 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:03 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62a5b02b-a8fe-4bd1-b9c4-10854949b1d9 tempest-ProjectReaderTests-948494610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.3023871f-376b-4e6c-b06f-51b2d3e69bdb" returned: 0 in 0.451s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:03 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-62a5b02b-a8fe-4bd1-b9c4-10854949b1d9 tempest-ProjectReaderTests-948494610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:30:03 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6569355-4984-46a3-ac35-75caaae0da5e]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:03 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62a5b02b-a8fe-4bd1-b9c4-10854949b1d9 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:03 devstack sudo[108725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9 Sep 28 17:30:03 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:03 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dfe3e7c2-0e48-4479-9755-bbfedb8175a0 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.info" returned: 0 in 0.316s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:04 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-dfe3e7c2-0e48-4479-9755-bbfedb8175a0 tempest-ProjectMemberTests-584998297 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.info is being set with open permissions: ugo+rw Sep 28 17:30:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dfe3e7c2-0e48-4479-9755-bbfedb8175a0 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:04 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.info Sep 28 17:30:04 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:04 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62a5b02b-a8fe-4bd1-b9c4-10854949b1d9 tempest-ProjectReaderTests-948494610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9" returned: 0 in 0.430s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62a5b02b-a8fe-4bd1-b9c4-10854949b1d9 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.3023871f-376b-4e6c-b06f-51b2d3e69bdb {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:04 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.3023871f-376b-4e6c-b06f-51b2d3e69bdb Sep 28 17:30:04 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:04 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-dfe3e7c2-0e48-4479-9755-bbfedb8175a0 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.info" returned: 0 in 0.297s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-dfe3e7c2-0e48-4479-9755-bbfedb8175a0 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.245s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:04 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-dfe3e7c2-0e48-4479-9755-bbfedb8175a0 tempest-ProjectMemberTests-584998297 None] Create snapshot completed successfully Sep 28 17:30:04 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62a5b02b-a8fe-4bd1-b9c4-10854949b1d9 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.3023871f-376b-4e6c-b06f-51b2d3e69bdb" returned: 0 in 0.382s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62a5b02b-a8fe-4bd1-b9c4-10854949b1d9 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.3023871f-376b-4e6c-b06f-51b2d3e69bdb {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:04 devstack sudo[108740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.3023871f-376b-4e6c-b06f-51b2d3e69bdb Sep 28 17:30:04 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2a498d9c-db4b-4010-8add-3c5064923e37 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-c9494dbe-6b15-4cf1-82f9-d66efbbc52e2-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2a498d9c-db4b-4010-8add-3c5064923e37 tempest-ProjectMemberTests-584998297 None] Lock "cinder-c9494dbe-6b15-4cf1-82f9-d66efbbc52e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2a498d9c-db4b-4010-8add-3c5064923e37 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-ce53bbdc-6877-4e9b-be62-e6a65a930251" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2a498d9c-db4b-4010-8add-3c5064923e37 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-ce53bbdc-6877-4e9b-be62-e6a65a930251" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2a498d9c-db4b-4010-8add-3c5064923e37 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-c9494dbe-6b15-4cf1-82f9-d66efbbc52e2" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2a498d9c-db4b-4010-8add-3c5064923e37 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-c9494dbe-6b15-4cf1-82f9-d66efbbc52e2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-2a498d9c-db4b-4010-8add-3c5064923e37 tempest-ProjectMemberTests-584998297 None] Deleting offline snapshot c9494dbe-6b15-4cf1-82f9-d66efbbc52e2 of volume ce53bbdc-6877-4e9b-be62-e6a65a930251 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:30:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-2a498d9c-db4b-4010-8add-3c5064923e37 tempest-ProjectMemberTests-584998297 None] snapshot_file for this snap is: volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.c9494dbe-6b15-4cf1-82f9-d66efbbc52e2 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:30:04 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1bdbed-9b6d-4a8b-bdcf-869fd193934b]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2a498d9c-db4b-4010-8add-3c5064923e37 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.c9494dbe-6b15-4cf1-82f9-d66efbbc52e2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:04 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-62a5b02b-a8fe-4bd1-b9c4-10854949b1d9 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9.3023871f-376b-4e6c-b06f-51b2d3e69bdb" returned: 0 in 0.300s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-62a5b02b-a8fe-4bd1-b9c4-10854949b1d9 tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-3023871f-376b-4e6c-b06f-51b2d3e69bdb" released by "_delete_snapshot" :: held 1.708s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-62a5b02b-a8fe-4bd1-b9c4-10854949b1d9 tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-a3acd9be-28b6-4f4a-a151-95fbc4e379d9" released by "delete_snapshot" :: held 1.738s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:05 devstack sudo[108743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.c9494dbe-6b15-4cf1-82f9-d66efbbc52e2 Sep 28 17:30:05 devstack sudo[108743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:05 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-62a5b02b-a8fe-4bd1-b9c4-10854949b1d9 tempest-ProjectReaderTests-948494610 None] Created reservations ['6bc698aa-7a76-4220-b73d-4544f78cc521', '95f8ee34-479b-4d47-ae2f-e56f9550b6d4', '42884ae3-5ba7-40ef-8165-6f2562ef8557', 'f700b038-82fe-410a-a0b1-d840bd368271'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:30:05 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-62a5b02b-a8fe-4bd1-b9c4-10854949b1d9 tempest-ProjectReaderTests-948494610 None] Delete snapshot completed successfully. Sep 28 17:30:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-62a5b02b-a8fe-4bd1-b9c4-10854949b1d9 tempest-ProjectReaderTests-948494610 None] Lock "cinder-3023871f-376b-4e6c-b06f-51b2d3e69bdb-delete_snapshot" released by "delete_snapshot" :: held 1.922s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:05 devstack sudo[108743]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2a498d9c-db4b-4010-8add-3c5064923e37 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.c9494dbe-6b15-4cf1-82f9-d66efbbc52e2" returned: 0 in 0.456s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-2a498d9c-db4b-4010-8add-3c5064923e37 tempest-ProjectMemberTests-584998297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce53bbdc-6877-4e9b-be62-e6a65a930251(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:30:05 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07b0ab4-9063-4c0c-bfda-03112cfa4fea]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2a498d9c-db4b-4010-8add-3c5064923e37 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-32c75a37-2272-48a8-be52-0c60535f25f0 tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-a3acd9be-28b6-4f4a-a151-95fbc4e379d9-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-32c75a37-2272-48a8-be52-0c60535f25f0 tempest-ProjectReaderTests-948494610 None] Lock "cinder-a3acd9be-28b6-4f4a-a151-95fbc4e379d9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:05 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251 Sep 28 17:30:05 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-32c75a37-2272-48a8-be52-0c60535f25f0 tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-quobyte-a3acd9be-28b6-4f4a-a151-95fbc4e379d9" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-32c75a37-2272-48a8-be52-0c60535f25f0 tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-a3acd9be-28b6-4f4a-a151-95fbc4e379d9" acquired by "delete_volume" :: waited 0.017s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:05 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3af22d0-7a60-4aa2-87ed-f2b2c76a0334]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-32c75a37-2272-48a8-be52-0c60535f25f0 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:05 devstack sudo[108751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9 Sep 28 17:30:05 devstack sudo[108751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:05 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2a498d9c-db4b-4010-8add-3c5064923e37 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251" returned: 0 in 0.449s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2a498d9c-db4b-4010-8add-3c5064923e37 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.c9494dbe-6b15-4cf1-82f9-d66efbbc52e2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:05 devstack sudo[108756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.c9494dbe-6b15-4cf1-82f9-d66efbbc52e2 Sep 28 17:30:05 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:06 devstack sudo[108751]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-32c75a37-2272-48a8-be52-0c60535f25f0 tempest-ProjectReaderTests-948494610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9" returned: 0 in 0.475s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-32c75a37-2272-48a8-be52-0c60535f25f0 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:06 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9 Sep 28 17:30:06 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:06 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2a498d9c-db4b-4010-8add-3c5064923e37 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.c9494dbe-6b15-4cf1-82f9-d66efbbc52e2" returned: 0 in 0.443s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2a498d9c-db4b-4010-8add-3c5064923e37 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.c9494dbe-6b15-4cf1-82f9-d66efbbc52e2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:06 devstack sudo[108766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.c9494dbe-6b15-4cf1-82f9-d66efbbc52e2 Sep 28 17:30:06 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:06 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-32c75a37-2272-48a8-be52-0c60535f25f0 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-a3acd9be-28b6-4f4a-a151-95fbc4e379d9" returned: 0 in 0.331s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-32c75a37-2272-48a8-be52-0c60535f25f0 tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-a3acd9be-28b6-4f4a-a151-95fbc4e379d9" released by "delete_volume" :: held 0.903s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-32c75a37-2272-48a8-be52-0c60535f25f0 tempest-ProjectReaderTests-948494610 None] Created reservations ['5848a1eb-5665-403c-a648-9962d90fbe8b', 'b0c42121-4636-477e-9425-ebed3214b37f', '51c0ea3c-f592-467a-9a9a-6863ce611fec', 'e3ff066b-5a41-45dc-a1c1-a681c11471de'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:30:06 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2a498d9c-db4b-4010-8add-3c5064923e37 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251.c9494dbe-6b15-4cf1-82f9-d66efbbc52e2" returned: 0 in 0.331s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2a498d9c-db4b-4010-8add-3c5064923e37 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-c9494dbe-6b15-4cf1-82f9-d66efbbc52e2" released by "_delete_snapshot" :: held 1.828s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-32c75a37-2272-48a8-be52-0c60535f25f0 tempest-ProjectReaderTests-948494610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-32c75a37-2272-48a8-be52-0c60535f25f0 tempest-ProjectReaderTests-948494610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-32c75a37-2272-48a8-be52-0c60535f25f0 tempest-ProjectReaderTests-948494610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-32c75a37-2272-48a8-be52-0c60535f25f0 tempest-ProjectReaderTests-948494610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-32c75a37-2272-48a8-be52-0c60535f25f0 tempest-ProjectReaderTests-948494610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-32c75a37-2272-48a8-be52-0c60535f25f0 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2a498d9c-db4b-4010-8add-3c5064923e37 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-ce53bbdc-6877-4e9b-be62-e6a65a930251" released by "delete_snapshot" :: held 1.881s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:06 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:30:06 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-2a498d9c-db4b-4010-8add-3c5064923e37 tempest-ProjectMemberTests-584998297 None] Created reservations ['f47a168d-6191-4afa-a216-3d3456f3904b', '8e5fcdbd-fc84-4aaa-8300-528650b5428b', '4e664f34-bd99-4438-b059-6ea20345d171', 'ce3eff50-adab-4fe9-9b96-7a96f4533aee'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:06 devstack sudo[108772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:30:06 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:06 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-2a498d9c-db4b-4010-8add-3c5064923e37 tempest-ProjectMemberTests-584998297 None] Delete snapshot completed successfully. Sep 28 17:30:06 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-2a498d9c-db4b-4010-8add-3c5064923e37 tempest-ProjectMemberTests-584998297 None] Lock "cinder-c9494dbe-6b15-4cf1-82f9-d66efbbc52e2-delete_snapshot" released by "delete_snapshot" :: held 2.134s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:06 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-32c75a37-2272-48a8-be52-0c60535f25f0 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.326s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-32c75a37-2272-48a8-be52-0c60535f25f0 tempest-ProjectReaderTests-948494610 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:30:07 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-32c75a37-2272-48a8-be52-0c60535f25f0 tempest-ProjectReaderTests-948494610 None] Deleted volume successfully. Sep 28 17:30:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4b97c5cc-7a86-463e-8a2c-eab5facf3c3a tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-ce53bbdc-6877-4e9b-be62-e6a65a930251-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-32c75a37-2272-48a8-be52-0c60535f25f0 tempest-ProjectReaderTests-948494610 None] Lock "cinder-a3acd9be-28b6-4f4a-a151-95fbc4e379d9-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4b97c5cc-7a86-463e-8a2c-eab5facf3c3a tempest-ProjectMemberTests-584998297 None] Lock "cinder-ce53bbdc-6877-4e9b-be62-e6a65a930251-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4b97c5cc-7a86-463e-8a2c-eab5facf3c3a tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-ce53bbdc-6877-4e9b-be62-e6a65a930251" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4b97c5cc-7a86-463e-8a2c-eab5facf3c3a tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-ce53bbdc-6877-4e9b-be62-e6a65a930251" acquired by "delete_volume" :: waited 0.021s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:07 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.383s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:30:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:30:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:30:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:30:07 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4865818-c14a-4e9f-9803-6cd5c3aaedb5]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4b97c5cc-7a86-463e-8a2c-eab5facf3c3a tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:07 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251 Sep 28 17:30:07 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:07 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4b97c5cc-7a86-463e-8a2c-eab5facf3c3a tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251" returned: 0 in 0.395s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4b97c5cc-7a86-463e-8a2c-eab5facf3c3a tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:07 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251 Sep 28 17:30:07 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:07 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4b97c5cc-7a86-463e-8a2c-eab5facf3c3a tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ce53bbdc-6877-4e9b-be62-e6a65a930251" returned: 0 in 0.285s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4b97c5cc-7a86-463e-8a2c-eab5facf3c3a tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-ce53bbdc-6877-4e9b-be62-e6a65a930251" released by "delete_volume" :: held 0.776s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-4b97c5cc-7a86-463e-8a2c-eab5facf3c3a tempest-ProjectMemberTests-584998297 None] Created reservations ['338a574d-b205-4dd6-8191-e2e9e9e01c67', 'c3ada505-f895-4232-9313-af0b1ea4852d', '56102062-d3db-48a2-a1f4-e691221ac5f9', 'd96a33fb-4901-4dd1-bc3d-57e631544de2'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4b97c5cc-7a86-463e-8a2c-eab5facf3c3a tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4b97c5cc-7a86-463e-8a2c-eab5facf3c3a tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4b97c5cc-7a86-463e-8a2c-eab5facf3c3a tempest-ProjectMemberTests-584998297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-4b97c5cc-7a86-463e-8a2c-eab5facf3c3a tempest-ProjectMemberTests-584998297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-4b97c5cc-7a86-463e-8a2c-eab5facf3c3a tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4b97c5cc-7a86-463e-8a2c-eab5facf3c3a tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:08 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:30:08 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Flow 'volume_create_manager' (bab358c3-7ed9-4f86-9f95-fc2c1b0121f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1198605-5f6a-40c2-8e8b-b1cf0543e834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1198605-5f6a-40c2-8e8b-b1cf0543e834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1716360852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed8cc787-ab76-40a1-a830-fab2687a5b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee783b4cdea4e6cb2ac1f9c16155c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:30:08Z,use_quota=True,user_id='f7158827c0994f1ba079ebdc19eadcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4162afaf-5d77-4739-b6c9-f3b3e55857ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4162afaf-5d77-4739-b6c9-f3b3e55857ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96262aed-e781-4971-ba52-c70545735e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96262aed-e781-4971-ba52-c70545735e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed8cc787-ab76-40a1-a830-fab2687a5b4f', 'volume_name': 'volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ccbfdb5-21a1-483b-b424-524605ab112f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ccbfdb5-21a1-483b-b424-524605ab112f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c8ec12-4241-4474-839b-1d6b76082aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:08 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Volume ed8cc787-ab76-40a1-a830-fab2687a5b4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f', 'volume_size': 1} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1716360852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed8cc787-ab76-40a1-a830-fab2687a5b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee783b4cdea4e6cb2ac1f9c16155c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:30:08Z,use_quota=True,user_id='f7158827c0994f1ba079ebdc19eadcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Creating volume ed8cc787-ab76-40a1-a830-fab2687a5b4f {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:30:08 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:08 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-4b97c5cc-7a86-463e-8a2c-eab5facf3c3a tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.346s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-4b97c5cc-7a86-463e-8a2c-eab5facf3c3a tempest-ProjectMemberTests-584998297 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:30:08 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-4b97c5cc-7a86-463e-8a2c-eab5facf3c3a tempest-ProjectMemberTests-584998297 None] Deleted volume successfully. Sep 28 17:30:08 devstack sudo[108787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f 1073741824 Sep 28 17:30:08 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:08 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-4b97c5cc-7a86-463e-8a2c-eab5facf3c3a tempest-ProjectMemberTests-584998297 None] Lock "cinder-ce53bbdc-6877-4e9b-be62-e6a65a930251-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:30:09 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Flow 'volume_create_manager' (b32c3c90-c5bf-4ca6-9a25-bfe6d0ca7db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a2b21a4-227b-4668-9e44-09046a4cf55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f 1073741824" returned: 0 in 0.571s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a2b21a4-227b-4668-9e44-09046a4cf55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1932097493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb0b3dc-24d0-43ef-92b3-283eeff6155e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716b289f0179458f8e2e869e7ff71485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:30:09Z,use_quota=True,user_id='ccaca5bfad8b4b96b2ae3b66012f813b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7173a782-e7d6-466c-8169-7f3bd06e4422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7173a782-e7d6-466c-8169-7f3bd06e4422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c15cef7-d01a-4214-a5ec-758c698ebc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c15cef7-d01a-4214-a5ec-758c698ebc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfb0b3dc-24d0-43ef-92b3-283eeff6155e', 'volume_name': 'volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a7a11d-9657-481f-89e3-23af2c0a753c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a7a11d-9657-481f-89e3-23af2c0a753c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59211197-9641-4b47-9d88-d42559e5a796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:09 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Volume cfb0b3dc-24d0-43ef-92b3-283eeff6155e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e', 'volume_size': 1} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:09 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f Sep 28 17:30:09 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:09 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f" returned: 0 in 0.254s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.282s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1932097493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb0b3dc-24d0-43ef-92b3-283eeff6155e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716b289f0179458f8e2e869e7ff71485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:30:09Z,use_quota=True,user_id='ccaca5bfad8b4b96b2ae3b66012f813b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Creating volume cfb0b3dc-24d0-43ef-92b3-283eeff6155e {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:30:09 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c8ec12-4241-4474-839b-1d6b76082aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:09 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e 1073741824 Sep 28 17:30:09 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cee62eb-a7e0-47cf-8ea7-9060e45e3c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:09 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Volume volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f (ed8cc787-ab76-40a1-a830-fab2687a5b4f): created successfully Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cee62eb-a7e0-47cf-8ea7-9060e45e3c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Flow 'volume_create_manager' (bab358c3-7ed9-4f86-9f95-fc2c1b0121f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:30:09 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-2c0e52aa-776c-4ada-a82d-97a52bd9f07e tempest-ProjectReaderTests-948494610 None] Created volume successfully. Sep 28 17:30:09 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e 1073741824" returned: 0 in 0.448s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:09 devstack sudo[108801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e Sep 28 17:30:09 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:10 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e" returned: 0 in 0.270s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:30:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59211197-9641-4b47-9d88-d42559e5a796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056a05fe-fae3-42e9-a901-0fb9cc128faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:10 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Volume volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e (cfb0b3dc-24d0-43ef-92b3-283eeff6155e): created successfully Sep 28 17:30:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056a05fe-fae3-42e9-a901-0fb9cc128faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:10 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Flow 'volume_create_manager' (b32c3c90-c5bf-4ca6-9a25-bfe6d0ca7db2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:30:10 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-cf02576f-f3ba-4670-bf93-963d684b45ba tempest-ProjectMemberTests-584998297 None] Created volume successfully. Sep 28 17:30:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-df3f0be8-4faf-411e-95a5-5f7050d8f4a4 tempest-ProjectReaderTests-948494610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-df3f0be8-4faf-411e-95a5-5f7050d8f4a4 tempest-ProjectReaderTests-948494610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:10 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-df3f0be8-4faf-411e-95a5-5f7050d8f4a4 tempest-ProjectReaderTests-948494610 None] Creating offline snapshot a5710462-5073-4f75-8206-8d5c1d5e524f of volume ed8cc787-ab76-40a1-a830-fab2687a5b4f {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:30:10 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1d63e4-4f11-4964-9bc7-df209ffe62d8]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:10 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df3f0be8-4faf-411e-95a5-5f7050d8f4a4 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:10 devstack sudo[108804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f Sep 28 17:30:10 devstack sudo[108804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:11 devstack sudo[108804]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df3f0be8-4faf-411e-95a5-5f7050d8f4a4 tempest-ProjectReaderTests-948494610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f" returned: 0 in 0.469s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df3f0be8-4faf-411e-95a5-5f7050d8f4a4 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.a5710462-5073-4f75-8206-8d5c1d5e524f 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:11 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.a5710462-5073-4f75-8206-8d5c1d5e524f 1G Sep 28 17:30:11 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0ef05f52-3c38-429e-84dc-5094f1ae5cd5 tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:11 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df3f0be8-4faf-411e-95a5-5f7050d8f4a4 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.a5710462-5073-4f75-8206-8d5c1d5e524f 1G" returned: 0 in 0.421s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df3f0be8-4faf-411e-95a5-5f7050d8f4a4 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.a5710462-5073-4f75-8206-8d5c1d5e524f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:11 devstack sudo[108816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.a5710462-5073-4f75-8206-8d5c1d5e524f Sep 28 17:30:11 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:11 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df3f0be8-4faf-411e-95a5-5f7050d8f4a4 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.a5710462-5073-4f75-8206-8d5c1d5e524f" returned: 0 in 0.281s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:11 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-df3f0be8-4faf-411e-95a5-5f7050d8f4a4 tempest-ProjectReaderTests-948494610 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.a5710462-5073-4f75-8206-8d5c1d5e524f is being set with open permissions: ugo+rw Sep 28 17:30:11 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df3f0be8-4faf-411e-95a5-5f7050d8f4a4 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.a5710462-5073-4f75-8206-8d5c1d5e524f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:11 devstack sudo[108822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.a5710462-5073-4f75-8206-8d5c1d5e524f Sep 28 17:30:11 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:12 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df3f0be8-4faf-411e-95a5-5f7050d8f4a4 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.a5710462-5073-4f75-8206-8d5c1d5e524f" returned: 0 in 0.252s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df3f0be8-4faf-411e-95a5-5f7050d8f4a4 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:12 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.info Sep 28 17:30:12 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:12 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df3f0be8-4faf-411e-95a5-5f7050d8f4a4 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.info" returned: 0 in 0.293s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:12 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-df3f0be8-4faf-411e-95a5-5f7050d8f4a4 tempest-ProjectReaderTests-948494610 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.info is being set with open permissions: ugo+rw Sep 28 17:30:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df3f0be8-4faf-411e-95a5-5f7050d8f4a4 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:12 devstack sudo[108828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.info Sep 28 17:30:12 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:12 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-df3f0be8-4faf-411e-95a5-5f7050d8f4a4 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.info" returned: 0 in 0.258s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-df3f0be8-4faf-411e-95a5-5f7050d8f4a4 tempest-ProjectReaderTests-948494610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.073s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0ef05f52-3c38-429e-84dc-5094f1ae5cd5 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.471s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:12 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-0ef05f52-3c38-429e-84dc-5094f1ae5cd5 tempest-ProjectMemberTests-584998297 None] Creating offline snapshot 5f1e14bd-984c-4811-9cee-30725767db34 of volume cfb0b3dc-24d0-43ef-92b3-283eeff6155e {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:30:12 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-df3f0be8-4faf-411e-95a5-5f7050d8f4a4 tempest-ProjectReaderTests-948494610 None] Create snapshot completed successfully Sep 28 17:30:12 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1faefe34-a152-41a7-8d05-9ccb37e95f19]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:12 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0ef05f52-3c38-429e-84dc-5094f1ae5cd5 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:12 devstack sudo[108831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e Sep 28 17:30:12 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:13 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0ef05f52-3c38-429e-84dc-5094f1ae5cd5 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e" returned: 0 in 0.423s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0ef05f52-3c38-429e-84dc-5094f1ae5cd5 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.5f1e14bd-984c-4811-9cee-30725767db34 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:13 devstack sudo[108836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.5f1e14bd-984c-4811-9cee-30725767db34 1G Sep 28 17:30:13 devstack sudo[108836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:13 devstack sudo[108836]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0ef05f52-3c38-429e-84dc-5094f1ae5cd5 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.5f1e14bd-984c-4811-9cee-30725767db34 1G" returned: 0 in 0.405s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0ef05f52-3c38-429e-84dc-5094f1ae5cd5 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.5f1e14bd-984c-4811-9cee-30725767db34 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:13 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.5f1e14bd-984c-4811-9cee-30725767db34 Sep 28 17:30:13 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0bfe6726-eeb8-4c28-a456-6985bf0573c4 tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-a5710462-5073-4f75-8206-8d5c1d5e524f-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0bfe6726-eeb8-4c28-a456-6985bf0573c4 tempest-ProjectReaderTests-948494610 None] Lock "cinder-a5710462-5073-4f75-8206-8d5c1d5e524f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0bfe6726-eeb8-4c28-a456-6985bf0573c4 tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-quobyte-ed8cc787-ab76-40a1-a830-fab2687a5b4f" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0bfe6726-eeb8-4c28-a456-6985bf0573c4 tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-ed8cc787-ab76-40a1-a830-fab2687a5b4f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0bfe6726-eeb8-4c28-a456-6985bf0573c4 tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-quobyte-a5710462-5073-4f75-8206-8d5c1d5e524f" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:13 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0bfe6726-eeb8-4c28-a456-6985bf0573c4 tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-a5710462-5073-4f75-8206-8d5c1d5e524f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:13 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-0bfe6726-eeb8-4c28-a456-6985bf0573c4 tempest-ProjectReaderTests-948494610 None] Deleting offline snapshot a5710462-5073-4f75-8206-8d5c1d5e524f of volume ed8cc787-ab76-40a1-a830-fab2687a5b4f {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:30:13 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-0bfe6726-eeb8-4c28-a456-6985bf0573c4 tempest-ProjectReaderTests-948494610 None] snapshot_file for this snap is: volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.a5710462-5073-4f75-8206-8d5c1d5e524f {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:30:13 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed40adc2-61be-4c5f-8e91-bf6435ac2444]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0bfe6726-eeb8-4c28-a456-6985bf0573c4 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.a5710462-5073-4f75-8206-8d5c1d5e524f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:13 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0ef05f52-3c38-429e-84dc-5094f1ae5cd5 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.5f1e14bd-984c-4811-9cee-30725767db34" returned: 0 in 0.350s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:13 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-0ef05f52-3c38-429e-84dc-5094f1ae5cd5 tempest-ProjectMemberTests-584998297 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.5f1e14bd-984c-4811-9cee-30725767db34 is being set with open permissions: ugo+rw Sep 28 17:30:13 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0ef05f52-3c38-429e-84dc-5094f1ae5cd5 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.5f1e14bd-984c-4811-9cee-30725767db34 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:14 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.5f1e14bd-984c-4811-9cee-30725767db34 Sep 28 17:30:14 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:14 devstack sudo[108847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.a5710462-5073-4f75-8206-8d5c1d5e524f Sep 28 17:30:14 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:14 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0ef05f52-3c38-429e-84dc-5094f1ae5cd5 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.5f1e14bd-984c-4811-9cee-30725767db34" returned: 0 in 0.349s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0ef05f52-3c38-429e-84dc-5094f1ae5cd5 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:14 devstack sudo[108857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.info Sep 28 17:30:14 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:14 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0bfe6726-eeb8-4c28-a456-6985bf0573c4 tempest-ProjectReaderTests-948494610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.a5710462-5073-4f75-8206-8d5c1d5e524f" returned: 0 in 0.444s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:14 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-0bfe6726-eeb8-4c28-a456-6985bf0573c4 tempest-ProjectReaderTests-948494610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:30:14 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6e9fae-d340-46f8-9548-e217179123a9]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0bfe6726-eeb8-4c28-a456-6985bf0573c4 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:14 devstack sudo[108859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f Sep 28 17:30:14 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:14 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0ef05f52-3c38-429e-84dc-5094f1ae5cd5 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.info" returned: 0 in 0.312s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:14 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-0ef05f52-3c38-429e-84dc-5094f1ae5cd5 tempest-ProjectMemberTests-584998297 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.info is being set with open permissions: ugo+rw Sep 28 17:30:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0ef05f52-3c38-429e-84dc-5094f1ae5cd5 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:14 devstack sudo[108863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.info Sep 28 17:30:14 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:14 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0bfe6726-eeb8-4c28-a456-6985bf0573c4 tempest-ProjectReaderTests-948494610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f" returned: 0 in 0.452s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:14 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0bfe6726-eeb8-4c28-a456-6985bf0573c4 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.a5710462-5073-4f75-8206-8d5c1d5e524f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:14 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.a5710462-5073-4f75-8206-8d5c1d5e524f Sep 28 17:30:14 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:15 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0ef05f52-3c38-429e-84dc-5094f1ae5cd5 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.info" returned: 0 in 0.394s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0ef05f52-3c38-429e-84dc-5094f1ae5cd5 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.366s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:15 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-0ef05f52-3c38-429e-84dc-5094f1ae5cd5 tempest-ProjectMemberTests-584998297 None] Create snapshot completed successfully Sep 28 17:30:15 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0bfe6726-eeb8-4c28-a456-6985bf0573c4 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.a5710462-5073-4f75-8206-8d5c1d5e524f" returned: 0 in 0.439s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0bfe6726-eeb8-4c28-a456-6985bf0573c4 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.a5710462-5073-4f75-8206-8d5c1d5e524f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:15 devstack sudo[108920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.a5710462-5073-4f75-8206-8d5c1d5e524f Sep 28 17:30:15 devstack sudo[108920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8d499376-c802-455a-b6f3-d96439791dcb tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-5f1e14bd-984c-4811-9cee-30725767db34-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8d499376-c802-455a-b6f3-d96439791dcb tempest-ProjectMemberTests-584998297 None] Lock "cinder-5f1e14bd-984c-4811-9cee-30725767db34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8d499376-c802-455a-b6f3-d96439791dcb tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-cfb0b3dc-24d0-43ef-92b3-283eeff6155e" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8d499376-c802-455a-b6f3-d96439791dcb tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-cfb0b3dc-24d0-43ef-92b3-283eeff6155e" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8d499376-c802-455a-b6f3-d96439791dcb tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-5f1e14bd-984c-4811-9cee-30725767db34" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8d499376-c802-455a-b6f3-d96439791dcb tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-5f1e14bd-984c-4811-9cee-30725767db34" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:15 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-8d499376-c802-455a-b6f3-d96439791dcb tempest-ProjectMemberTests-584998297 None] Deleting offline snapshot 5f1e14bd-984c-4811-9cee-30725767db34 of volume cfb0b3dc-24d0-43ef-92b3-283eeff6155e {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:30:15 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-8d499376-c802-455a-b6f3-d96439791dcb tempest-ProjectMemberTests-584998297 None] snapshot_file for this snap is: volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.5f1e14bd-984c-4811-9cee-30725767db34 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:30:15 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[d741b960-4fa5-408d-8c67-5d73f5dcf867]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8d499376-c802-455a-b6f3-d96439791dcb tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.5f1e14bd-984c-4811-9cee-30725767db34 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:15 devstack sudo[108920]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:15 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0bfe6726-eeb8-4c28-a456-6985bf0573c4 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f.a5710462-5073-4f75-8206-8d5c1d5e524f" returned: 0 in 0.342s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0bfe6726-eeb8-4c28-a456-6985bf0573c4 tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-a5710462-5073-4f75-8206-8d5c1d5e524f" released by "_delete_snapshot" :: held 1.810s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0bfe6726-eeb8-4c28-a456-6985bf0573c4 tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-ed8cc787-ab76-40a1-a830-fab2687a5b4f" released by "delete_snapshot" :: held 1.834s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:15 devstack sudo[108922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.5f1e14bd-984c-4811-9cee-30725767db34 Sep 28 17:30:15 devstack sudo[108922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:15 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-0bfe6726-eeb8-4c28-a456-6985bf0573c4 tempest-ProjectReaderTests-948494610 None] Created reservations ['4b5dc494-9936-4626-a437-c95a5d0bfc25', '064f87af-cc35-47e9-9777-9652812d884d', '893eb6d5-0e1e-440d-82c1-d72ba708e3ad', '41ec425a-5cdc-478b-be39-b7ed6322546b'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:30:15 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-0bfe6726-eeb8-4c28-a456-6985bf0573c4 tempest-ProjectReaderTests-948494610 None] Delete snapshot completed successfully. Sep 28 17:30:15 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0bfe6726-eeb8-4c28-a456-6985bf0573c4 tempest-ProjectReaderTests-948494610 None] Lock "cinder-a5710462-5073-4f75-8206-8d5c1d5e524f-delete_snapshot" released by "delete_snapshot" :: held 2.028s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-558b55a9-e94a-4f14-af0f-fe94fe304f7f tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-ed8cc787-ab76-40a1-a830-fab2687a5b4f-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-558b55a9-e94a-4f14-af0f-fe94fe304f7f tempest-ProjectReaderTests-948494610 None] Lock "cinder-ed8cc787-ab76-40a1-a830-fab2687a5b4f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:16 devstack sudo[108922]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8d499376-c802-455a-b6f3-d96439791dcb tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.5f1e14bd-984c-4811-9cee-30725767db34" returned: 0 in 0.613s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:16 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-8d499376-c802-455a-b6f3-d96439791dcb tempest-ProjectMemberTests-584998297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:30:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-558b55a9-e94a-4f14-af0f-fe94fe304f7f tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-quobyte-ed8cc787-ab76-40a1-a830-fab2687a5b4f" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:16 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[48756a7e-4f91-4ddb-a59f-c01fc3c209a1]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8d499376-c802-455a-b6f3-d96439791dcb tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:16 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-558b55a9-e94a-4f14-af0f-fe94fe304f7f tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-ed8cc787-ab76-40a1-a830-fab2687a5b4f" acquired by "delete_volume" :: waited 0.024s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:16 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5f167f-9d6e-46c9-97c5-caffeeb188d4]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-558b55a9-e94a-4f14-af0f-fe94fe304f7f tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:16 devstack sudo[108929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e Sep 28 17:30:16 devstack sudo[108929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:16 devstack sudo[108930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f Sep 28 17:30:16 devstack sudo[108930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:16 devstack sudo[108929]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8d499376-c802-455a-b6f3-d96439791dcb tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e" returned: 0 in 0.446s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8d499376-c802-455a-b6f3-d96439791dcb tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.5f1e14bd-984c-4811-9cee-30725767db34 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:16 devstack sudo[108936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.5f1e14bd-984c-4811-9cee-30725767db34 Sep 28 17:30:16 devstack sudo[108936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:16 devstack sudo[108930]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-558b55a9-e94a-4f14-af0f-fe94fe304f7f tempest-ProjectReaderTests-948494610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f" returned: 0 in 0.494s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:16 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-558b55a9-e94a-4f14-af0f-fe94fe304f7f tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:16 devstack sudo[108941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f Sep 28 17:30:16 devstack sudo[108941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:17 devstack sudo[108936]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8d499376-c802-455a-b6f3-d96439791dcb tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.5f1e14bd-984c-4811-9cee-30725767db34" returned: 0 in 0.454s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8d499376-c802-455a-b6f3-d96439791dcb tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.5f1e14bd-984c-4811-9cee-30725767db34 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:17 devstack sudo[108941]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-558b55a9-e94a-4f14-af0f-fe94fe304f7f tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-ed8cc787-ab76-40a1-a830-fab2687a5b4f" returned: 0 in 0.334s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:17 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.5f1e14bd-984c-4811-9cee-30725767db34 Sep 28 17:30:17 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-558b55a9-e94a-4f14-af0f-fe94fe304f7f tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-ed8cc787-ab76-40a1-a830-fab2687a5b4f" released by "delete_volume" :: held 0.933s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:17 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-558b55a9-e94a-4f14-af0f-fe94fe304f7f tempest-ProjectReaderTests-948494610 None] Created reservations ['6ad0a9a3-96e2-4fb7-9bac-29be9b5a982d', '7602fd6e-b389-4ea3-b971-cf8f4851dd20', '9b95065b-0ac2-43a8-a826-c7b18db42432', '21a6be7a-8ef4-41f5-9aba-34f0207dee6a'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:30:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-558b55a9-e94a-4f14-af0f-fe94fe304f7f tempest-ProjectReaderTests-948494610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-558b55a9-e94a-4f14-af0f-fe94fe304f7f tempest-ProjectReaderTests-948494610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-558b55a9-e94a-4f14-af0f-fe94fe304f7f tempest-ProjectReaderTests-948494610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-558b55a9-e94a-4f14-af0f-fe94fe304f7f tempest-ProjectReaderTests-948494610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-558b55a9-e94a-4f14-af0f-fe94fe304f7f tempest-ProjectReaderTests-948494610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-558b55a9-e94a-4f14-af0f-fe94fe304f7f tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:17 devstack sudo[108949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:30:17 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:17 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8d499376-c802-455a-b6f3-d96439791dcb tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e.5f1e14bd-984c-4811-9cee-30725767db34" returned: 0 in 0.311s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8d499376-c802-455a-b6f3-d96439791dcb tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-5f1e14bd-984c-4811-9cee-30725767db34" released by "_delete_snapshot" :: held 1.960s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8d499376-c802-455a-b6f3-d96439791dcb tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-cfb0b3dc-24d0-43ef-92b3-283eeff6155e" released by "delete_snapshot" :: held 1.993s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:17 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-8d499376-c802-455a-b6f3-d96439791dcb tempest-ProjectMemberTests-584998297 None] Created reservations ['b86722fa-0c2b-4d0a-8e1f-75790dccd194', 'b4e3736b-a7b2-4eaf-aad9-55e1af550916', '4c52dea5-7388-472c-8d99-ba934df45993', 'a34e3a23-cbfb-477c-bc5a-f27c74185a0a'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:30:17 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-8d499376-c802-455a-b6f3-d96439791dcb tempest-ProjectMemberTests-584998297 None] Delete snapshot completed successfully. Sep 28 17:30:17 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-558b55a9-e94a-4f14-af0f-fe94fe304f7f tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.318s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:17 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-558b55a9-e94a-4f14-af0f-fe94fe304f7f tempest-ProjectReaderTests-948494610 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:30:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8d499376-c802-455a-b6f3-d96439791dcb tempest-ProjectMemberTests-584998297 None] Lock "cinder-5f1e14bd-984c-4811-9cee-30725767db34-delete_snapshot" released by "delete_snapshot" :: held 2.208s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:17 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-558b55a9-e94a-4f14-af0f-fe94fe304f7f tempest-ProjectReaderTests-948494610 None] Deleted volume successfully. Sep 28 17:30:17 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-558b55a9-e94a-4f14-af0f-fe94fe304f7f tempest-ProjectReaderTests-948494610 None] Lock "cinder-ed8cc787-ab76-40a1-a830-fab2687a5b4f-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-21280b8a-2d7f-4747-a27a-0c556467f9ce tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-cfb0b3dc-24d0-43ef-92b3-283eeff6155e-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:18 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-21280b8a-2d7f-4747-a27a-0c556467f9ce tempest-ProjectMemberTests-584998297 None] Lock "cinder-cfb0b3dc-24d0-43ef-92b3-283eeff6155e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:18 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:30:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Flow 'volume_create_manager' (78f7f307-81b5-4ba6-9a66-f542e465e66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:30:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76286824-e88f-4bf7-8762-96a44776b1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76286824-e88f-4bf7-8762-96a44776b1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-566022328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a74fe01-0406-40c7-9503-760fe9dc24de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee783b4cdea4e6cb2ac1f9c16155c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:30:19Z,use_quota=True,user_id='f7158827c0994f1ba079ebdc19eadcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce960d9-a002-495d-b4c8-e1dfc2998377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce960d9-a002-495d-b4c8-e1dfc2998377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c910ef0-3ec4-4ee7-ba79-3c1bff894e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c910ef0-3ec4-4ee7-ba79-3c1bff894e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a74fe01-0406-40c7-9503-760fe9dc24de', 'volume_name': 'volume-3a74fe01-0406-40c7-9503-760fe9dc24de', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc1cf2f-47fe-4f07-8e1d-dd3f44983152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc1cf2f-47fe-4f07-8e1d-dd3f44983152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658ddf88-6e7c-4266-b3c4-36e32dd0e3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:19 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Volume 3a74fe01-0406-40c7-9503-760fe9dc24de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a74fe01-0406-40c7-9503-760fe9dc24de', 'volume_size': 1} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-566022328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a74fe01-0406-40c7-9503-760fe9dc24de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee783b4cdea4e6cb2ac1f9c16155c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:30:19Z,use_quota=True,user_id='f7158827c0994f1ba079ebdc19eadcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Creating volume 3a74fe01-0406-40c7-9503-760fe9dc24de {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:30:19 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-21280b8a-2d7f-4747-a27a-0c556467f9ce tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-cfb0b3dc-24d0-43ef-92b3-283eeff6155e" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:19 devstack sudo[108953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de 1073741824 Sep 28 17:30:19 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-21280b8a-2d7f-4747-a27a-0c556467f9ce tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-cfb0b3dc-24d0-43ef-92b3-283eeff6155e" acquired by "delete_volume" :: waited 0.026s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdcd61d-50e3-43ad-b065-cc2f93fc6bd3]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-21280b8a-2d7f-4747-a27a-0c556467f9ce tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:19 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e Sep 28 17:30:19 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:19 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de 1073741824" returned: 0 in 0.533s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:19 devstack sudo[108963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de Sep 28 17:30:19 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:19 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-21280b8a-2d7f-4747-a27a-0c556467f9ce tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e" returned: 0 in 0.472s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-21280b8a-2d7f-4747-a27a-0c556467f9ce tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:19 devstack sudo[108965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e Sep 28 17:30:19 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:19 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de" returned: 0 in 0.267s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658ddf88-6e7c-4266-b3c4-36e32dd0e3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a74fe01-0406-40c7-9503-760fe9dc24de', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03eff7c7-2ae5-4a14-a0ea-ce62f2d624dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:19 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:19 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Volume volume-3a74fe01-0406-40c7-9503-760fe9dc24de (3a74fe01-0406-40c7-9503-760fe9dc24de): created successfully Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03eff7c7-2ae5-4a14-a0ea-ce62f2d624dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Flow 'volume_create_manager' (78f7f307-81b5-4ba6-9a66-f542e465e66c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-21280b8a-2d7f-4747-a27a-0c556467f9ce tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-cfb0b3dc-24d0-43ef-92b3-283eeff6155e" returned: 0 in 0.281s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:19 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-21280b8a-2d7f-4747-a27a-0c556467f9ce tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-cfb0b3dc-24d0-43ef-92b3-283eeff6155e" released by "delete_volume" :: held 0.840s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:19 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-ba9943be-6ccf-4554-99fe-1bae6589dcb4 tempest-ProjectReaderTests-948494610 None] Created volume successfully. Sep 28 17:30:20 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-21280b8a-2d7f-4747-a27a-0c556467f9ce tempest-ProjectMemberTests-584998297 None] Created reservations ['8c208914-a637-4a83-8428-ce528f3d5e3c', 'efe25ede-63a3-4ce8-9af7-a54c01b0168e', 'a2e15fe1-a1ef-47ee-b6ef-19a2906a13d6', '4e0060a2-c9c1-4e13-9fc6-bf79f1e4a060'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:30:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-21280b8a-2d7f-4747-a27a-0c556467f9ce tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-21280b8a-2d7f-4747-a27a-0c556467f9ce tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:20 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-21280b8a-2d7f-4747-a27a-0c556467f9ce tempest-ProjectMemberTests-584998297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:20 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-21280b8a-2d7f-4747-a27a-0c556467f9ce tempest-ProjectMemberTests-584998297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-21280b8a-2d7f-4747-a27a-0c556467f9ce tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-21280b8a-2d7f-4747-a27a-0c556467f9ce tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:20 devstack sudo[108969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:30:20 devstack sudo[108969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:20 devstack sudo[108969]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-21280b8a-2d7f-4747-a27a-0c556467f9ce tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.268s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:20 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-21280b8a-2d7f-4747-a27a-0c556467f9ce tempest-ProjectMemberTests-584998297 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:30:20 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-21280b8a-2d7f-4747-a27a-0c556467f9ce tempest-ProjectMemberTests-584998297 None] Deleted volume successfully. Sep 28 17:30:20 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-21280b8a-2d7f-4747-a27a-0c556467f9ce tempest-ProjectMemberTests-584998297 None] Lock "cinder-cfb0b3dc-24d0-43ef-92b3-283eeff6155e-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a3a3b7c7-6c7e-45ce-9581-5030ad08e7a0 tempest-ProjectReaderTests-948494610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a3a3b7c7-6c7e-45ce-9581-5030ad08e7a0 tempest-ProjectReaderTests-948494610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:21 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-a3a3b7c7-6c7e-45ce-9581-5030ad08e7a0 tempest-ProjectReaderTests-948494610 None] Creating offline snapshot 50c4bbba-d5d0-412c-8afe-14e6c4090551 of volume 3a74fe01-0406-40c7-9503-760fe9dc24de {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:30:21 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24248a5-d330-4e69-8c87-a82bb878b61d]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3a3b7c7-6c7e-45ce-9581-5030ad08e7a0 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:21 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de Sep 28 17:30:21 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:21 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3a3b7c7-6c7e-45ce-9581-5030ad08e7a0 tempest-ProjectReaderTests-948494610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de" returned: 0 in 0.458s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3a3b7c7-6c7e-45ce-9581-5030ad08e7a0 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.50c4bbba-d5d0-412c-8afe-14e6c4090551 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:21 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.50c4bbba-d5d0-412c-8afe-14e6c4090551 1G Sep 28 17:30:21 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:21 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:30:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Flow 'volume_create_manager' (1da30c87-d7f4-4162-b6d2-ccbc9ef42507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:30:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7a4dfc-ee85-436b-8e25-c12b0657a1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7a4dfc-ee85-436b-8e25-c12b0657a1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1953074818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716b289f0179458f8e2e869e7ff71485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:30:22Z,use_quota=True,user_id='ccaca5bfad8b4b96b2ae3b66012f813b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ac566f-cef5-4880-b488-71e6cc3cea3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ac566f-cef5-4880-b488-71e6cc3cea3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d382b1e7-c8b2-4190-98c3-86477effba6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d382b1e7-c8b2-4190-98c3-86477effba6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2', 'volume_name': 'volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b011527e-9d7c-452c-88fe-619ba736e8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b011527e-9d7c-452c-88fe-619ba736e8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:21 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f4365d-e17b-4401-9b39-3930d298a2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:21 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Volume 9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2', 'volume_size': 1} Sep 28 17:30:21 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:22 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3a3b7c7-6c7e-45ce-9581-5030ad08e7a0 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.50c4bbba-d5d0-412c-8afe-14e6c4090551 1G" returned: 0 in 0.432s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3a3b7c7-6c7e-45ce-9581-5030ad08e7a0 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a74fe01-0406-40c7-9503-760fe9dc24de -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.50c4bbba-d5d0-412c-8afe-14e6c4090551 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:22 devstack sudo[108983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a74fe01-0406-40c7-9503-760fe9dc24de -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.50c4bbba-d5d0-412c-8afe-14e6c4090551 Sep 28 17:30:22 devstack sudo[108983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:22 devstack sudo[108983]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3a3b7c7-6c7e-45ce-9581-5030ad08e7a0 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a74fe01-0406-40c7-9503-760fe9dc24de -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.50c4bbba-d5d0-412c-8afe-14e6c4090551" returned: 0 in 0.367s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:22 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-a3a3b7c7-6c7e-45ce-9581-5030ad08e7a0 tempest-ProjectReaderTests-948494610 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.50c4bbba-d5d0-412c-8afe-14e6c4090551 is being set with open permissions: ugo+rw Sep 28 17:30:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3a3b7c7-6c7e-45ce-9581-5030ad08e7a0 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.50c4bbba-d5d0-412c-8afe-14e6c4090551 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:22 devstack sudo[108988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.50c4bbba-d5d0-412c-8afe-14e6c4090551 Sep 28 17:30:22 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:22 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3a3b7c7-6c7e-45ce-9581-5030ad08e7a0 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.50c4bbba-d5d0-412c-8afe-14e6c4090551" returned: 0 in 0.305s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:22 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3a3b7c7-6c7e-45ce-9581-5030ad08e7a0 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:22 devstack sudo[108991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.info Sep 28 17:30:22 devstack sudo[108991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:23 devstack sudo[108991]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3a3b7c7-6c7e-45ce-9581-5030ad08e7a0 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.info" returned: 0 in 0.311s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:23 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-a3a3b7c7-6c7e-45ce-9581-5030ad08e7a0 tempest-ProjectReaderTests-948494610 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.info is being set with open permissions: ugo+rw Sep 28 17:30:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3a3b7c7-6c7e-45ce-9581-5030ad08e7a0 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:23 devstack sudo[108994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.info Sep 28 17:30:23 devstack sudo[108994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:23 devstack sudo[108994]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-a3a3b7c7-6c7e-45ce-9581-5030ad08e7a0 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.info" returned: 0 in 0.243s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-a3a3b7c7-6c7e-45ce-9581-5030ad08e7a0 tempest-ProjectReaderTests-948494610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.232s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.581s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:23 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1953074818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716b289f0179458f8e2e869e7ff71485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:30:22Z,use_quota=True,user_id='ccaca5bfad8b4b96b2ae3b66012f813b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:30:23 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Creating volume 9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:30:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:23 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:23 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:23 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:30:23 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:30:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:23 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2 1073741824 Sep 28 17:30:23 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:23 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-a3a3b7c7-6c7e-45ce-9581-5030ad08e7a0 tempest-ProjectReaderTests-948494610 None] Create snapshot completed successfully Sep 28 17:30:23 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:23 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2 1073741824" returned: 0 in 0.537s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:24 devstack sudo[109003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2 Sep 28 17:30:24 devstack sudo[109003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:24 devstack sudo[109003]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2" returned: 0 in 0.299s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:30:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f4365d-e17b-4401-9b39-3930d298a2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5652fdee-084d-4e48-8383-e2f3dedf523b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bf34b414-2c10-47db-a403-81af1d359342 tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-50c4bbba-d5d0-412c-8afe-14e6c4090551-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:24 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Volume volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2 (9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2): created successfully Sep 28 17:30:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5652fdee-084d-4e48-8383-e2f3dedf523b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:24 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Flow 'volume_create_manager' (1da30c87-d7f4-4162-b6d2-ccbc9ef42507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:30:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bf34b414-2c10-47db-a403-81af1d359342 tempest-ProjectReaderTests-948494610 None] Lock "cinder-50c4bbba-d5d0-412c-8afe-14e6c4090551-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bf34b414-2c10-47db-a403-81af1d359342 tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-quobyte-3a74fe01-0406-40c7-9503-760fe9dc24de" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:24 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-1ae40473-7165-4286-ba10-0b26ccc54886 tempest-ProjectMemberTests-584998297 None] Created volume successfully. Sep 28 17:30:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bf34b414-2c10-47db-a403-81af1d359342 tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-3a74fe01-0406-40c7-9503-760fe9dc24de" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bf34b414-2c10-47db-a403-81af1d359342 tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-quobyte-50c4bbba-d5d0-412c-8afe-14e6c4090551" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:24 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bf34b414-2c10-47db-a403-81af1d359342 tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-50c4bbba-d5d0-412c-8afe-14e6c4090551" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-bf34b414-2c10-47db-a403-81af1d359342 tempest-ProjectReaderTests-948494610 None] Deleting offline snapshot 50c4bbba-d5d0-412c-8afe-14e6c4090551 of volume 3a74fe01-0406-40c7-9503-760fe9dc24de {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:30:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-bf34b414-2c10-47db-a403-81af1d359342 tempest-ProjectReaderTests-948494610 None] snapshot_file for this snap is: volume-3a74fe01-0406-40c7-9503-760fe9dc24de.50c4bbba-d5d0-412c-8afe-14e6c4090551 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:30:24 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee99c2ab-86e0-4b31-bc89-d1fab86c5cf1]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bf34b414-2c10-47db-a403-81af1d359342 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.50c4bbba-d5d0-412c-8afe-14e6c4090551 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:24 devstack sudo[109006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.50c4bbba-d5d0-412c-8afe-14e6c4090551 Sep 28 17:30:24 devstack sudo[109006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:24 devstack sudo[109006]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bf34b414-2c10-47db-a403-81af1d359342 tempest-ProjectReaderTests-948494610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.50c4bbba-d5d0-412c-8afe-14e6c4090551" returned: 0 in 0.394s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:24 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-bf34b414-2c10-47db-a403-81af1d359342 tempest-ProjectReaderTests-948494610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a74fe01-0406-40c7-9503-760fe9dc24de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:30:24 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5fdca5-07f7-4430-9ed8-36248c14607b]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:24 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bf34b414-2c10-47db-a403-81af1d359342 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:25 devstack sudo[109012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de Sep 28 17:30:25 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2f39faab-26fd-4ac9-a9b7-60b4b5afc2f4 tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2f39faab-26fd-4ac9-a9b7-60b4b5afc2f4 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:25 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-2f39faab-26fd-4ac9-a9b7-60b4b5afc2f4 tempest-ProjectMemberTests-584998297 None] Creating offline snapshot a728d255-deb1-429a-b838-dd42dc87a605 of volume 9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:30:25 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2adfedd-b2a4-446b-80c2-e16ae32ac67a]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2f39faab-26fd-4ac9-a9b7-60b4b5afc2f4 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:25 devstack sudo[109014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2 Sep 28 17:30:25 devstack sudo[109014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:25 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bf34b414-2c10-47db-a403-81af1d359342 tempest-ProjectReaderTests-948494610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de" returned: 0 in 0.447s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bf34b414-2c10-47db-a403-81af1d359342 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.50c4bbba-d5d0-412c-8afe-14e6c4090551 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:25 devstack sudo[109019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.50c4bbba-d5d0-412c-8afe-14e6c4090551 Sep 28 17:30:25 devstack sudo[109019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:25 devstack sudo[109014]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2f39faab-26fd-4ac9-a9b7-60b4b5afc2f4 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2" returned: 0 in 0.437s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2f39faab-26fd-4ac9-a9b7-60b4b5afc2f4 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.a728d255-deb1-429a-b838-dd42dc87a605 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:25 devstack sudo[109027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.a728d255-deb1-429a-b838-dd42dc87a605 1G Sep 28 17:30:25 devstack sudo[109027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:25 devstack sudo[109019]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bf34b414-2c10-47db-a403-81af1d359342 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.50c4bbba-d5d0-412c-8afe-14e6c4090551" returned: 0 in 0.381s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:25 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bf34b414-2c10-47db-a403-81af1d359342 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.50c4bbba-d5d0-412c-8afe-14e6c4090551 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:25 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.50c4bbba-d5d0-412c-8afe-14e6c4090551 Sep 28 17:30:25 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:26 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-bf34b414-2c10-47db-a403-81af1d359342 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de.50c4bbba-d5d0-412c-8afe-14e6c4090551" returned: 0 in 0.351s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:26 devstack sudo[109027]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bf34b414-2c10-47db-a403-81af1d359342 tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-50c4bbba-d5d0-412c-8afe-14e6c4090551" released by "_delete_snapshot" :: held 1.714s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2f39faab-26fd-4ac9-a9b7-60b4b5afc2f4 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.a728d255-deb1-429a-b838-dd42dc87a605 1G" returned: 0 in 0.517s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2f39faab-26fd-4ac9-a9b7-60b4b5afc2f4 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.a728d255-deb1-429a-b838-dd42dc87a605 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bf34b414-2c10-47db-a403-81af1d359342 tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-3a74fe01-0406-40c7-9503-760fe9dc24de" released by "delete_snapshot" :: held 1.750s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:26 devstack sudo[109036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.a728d255-deb1-429a-b838-dd42dc87a605 Sep 28 17:30:26 devstack sudo[109036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:26 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-bf34b414-2c10-47db-a403-81af1d359342 tempest-ProjectReaderTests-948494610 None] Created reservations ['17079724-8c61-4b64-854d-1556df9cb008', '19838a44-5c88-43e8-8b00-01e8feb8000b', 'c7497375-6fa8-4fe4-8da0-3f85b3fc17c2', '12abe44a-9f2d-4579-8d68-46e92440aee5'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:30:26 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-bf34b414-2c10-47db-a403-81af1d359342 tempest-ProjectReaderTests-948494610 None] Delete snapshot completed successfully. Sep 28 17:30:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-bf34b414-2c10-47db-a403-81af1d359342 tempest-ProjectReaderTests-948494610 None] Lock "cinder-50c4bbba-d5d0-412c-8afe-14e6c4090551-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:26 devstack sudo[109036]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2f39faab-26fd-4ac9-a9b7-60b4b5afc2f4 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.a728d255-deb1-429a-b838-dd42dc87a605" returned: 0 in 0.331s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:26 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-2f39faab-26fd-4ac9-a9b7-60b4b5afc2f4 tempest-ProjectMemberTests-584998297 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.a728d255-deb1-429a-b838-dd42dc87a605 is being set with open permissions: ugo+rw Sep 28 17:30:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2f39faab-26fd-4ac9-a9b7-60b4b5afc2f4 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.a728d255-deb1-429a-b838-dd42dc87a605 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:26 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.a728d255-deb1-429a-b838-dd42dc87a605 Sep 28 17:30:26 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7ddbe91e-1200-4543-afe6-2c5d7ad13fe9 tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-3a74fe01-0406-40c7-9503-760fe9dc24de-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7ddbe91e-1200-4543-afe6-2c5d7ad13fe9 tempest-ProjectReaderTests-948494610 None] Lock "cinder-3a74fe01-0406-40c7-9503-760fe9dc24de-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7ddbe91e-1200-4543-afe6-2c5d7ad13fe9 tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-quobyte-3a74fe01-0406-40c7-9503-760fe9dc24de" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:26 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7ddbe91e-1200-4543-afe6-2c5d7ad13fe9 tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-3a74fe01-0406-40c7-9503-760fe9dc24de" acquired by "delete_volume" :: waited 0.016s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:26 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00610bc-5467-4cd3-a324-9be4c1fe09a2]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7ddbe91e-1200-4543-afe6-2c5d7ad13fe9 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:26 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2f39faab-26fd-4ac9-a9b7-60b4b5afc2f4 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.a728d255-deb1-429a-b838-dd42dc87a605" returned: 0 in 0.297s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:26 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2f39faab-26fd-4ac9-a9b7-60b4b5afc2f4 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:26 devstack sudo[109043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de Sep 28 17:30:26 devstack sudo[109043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:26 devstack sudo[109045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.info Sep 28 17:30:26 devstack sudo[109045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:27 devstack sudo[109045]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2f39faab-26fd-4ac9-a9b7-60b4b5afc2f4 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.info" returned: 0 in 0.338s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:27 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-2f39faab-26fd-4ac9-a9b7-60b4b5afc2f4 tempest-ProjectMemberTests-584998297 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.info is being set with open permissions: ugo+rw Sep 28 17:30:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2f39faab-26fd-4ac9-a9b7-60b4b5afc2f4 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:27 devstack sudo[109043]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7ddbe91e-1200-4543-afe6-2c5d7ad13fe9 tempest-ProjectReaderTests-948494610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de" returned: 0 in 0.461s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7ddbe91e-1200-4543-afe6-2c5d7ad13fe9 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:27 devstack sudo[109052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.info Sep 28 17:30:27 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:27 devstack sudo[109053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de Sep 28 17:30:27 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:27 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-2f39faab-26fd-4ac9-a9b7-60b4b5afc2f4 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.info" returned: 0 in 0.301s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:27 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-2f39faab-26fd-4ac9-a9b7-60b4b5afc2f4 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.334s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7ddbe91e-1200-4543-afe6-2c5d7ad13fe9 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-3a74fe01-0406-40c7-9503-760fe9dc24de" returned: 0 in 0.316s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:27 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7ddbe91e-1200-4543-afe6-2c5d7ad13fe9 tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-3a74fe01-0406-40c7-9503-760fe9dc24de" released by "delete_volume" :: held 0.877s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:27 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-2f39faab-26fd-4ac9-a9b7-60b4b5afc2f4 tempest-ProjectMemberTests-584998297 None] Create snapshot completed successfully Sep 28 17:30:27 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-7ddbe91e-1200-4543-afe6-2c5d7ad13fe9 tempest-ProjectReaderTests-948494610 None] Created reservations ['eac1cfe4-ee75-47c9-8e97-059a981d013e', 'e711fd12-be81-423d-bb7d-0e2bd8a49536', 'd3379eca-61b4-4a54-8db7-35bf13d9e859', 'f729d514-e778-41b4-97b7-e1f597b9e741'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:30:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7ddbe91e-1200-4543-afe6-2c5d7ad13fe9 tempest-ProjectReaderTests-948494610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7ddbe91e-1200-4543-afe6-2c5d7ad13fe9 tempest-ProjectReaderTests-948494610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:27 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7ddbe91e-1200-4543-afe6-2c5d7ad13fe9 tempest-ProjectReaderTests-948494610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:27 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-7ddbe91e-1200-4543-afe6-2c5d7ad13fe9 tempest-ProjectReaderTests-948494610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-7ddbe91e-1200-4543-afe6-2c5d7ad13fe9 tempest-ProjectReaderTests-948494610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:27 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7ddbe91e-1200-4543-afe6-2c5d7ad13fe9 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:27 devstack sudo[109058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:30:27 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:28 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-7ddbe91e-1200-4543-afe6-2c5d7ad13fe9 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.332s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-7ddbe91e-1200-4543-afe6-2c5d7ad13fe9 tempest-ProjectReaderTests-948494610 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:30:28 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-7ddbe91e-1200-4543-afe6-2c5d7ad13fe9 tempest-ProjectReaderTests-948494610 None] Deleted volume successfully. Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-7ddbe91e-1200-4543-afe6-2c5d7ad13fe9 tempest-ProjectReaderTests-948494610 None] Lock "cinder-3a74fe01-0406-40c7-9503-760fe9dc24de-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-984f02d5-6032-40bb-9f93-35d69b9eea17 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-a728d255-deb1-429a-b838-dd42dc87a605-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=171,cinder:INSERT=50,cinder:UPDATE=197,cinder:DELETE=18 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=141,cinder:INSERT=60,cinder:UPDATE=210,cinder:DELETE=17 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Flow 'volume_create_manager' (66c3c91c-d894-4bbc-9694-ee45896aadd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a9218bd-cab4-451a-81d1-d7067c3d467a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-984f02d5-6032-40bb-9f93-35d69b9eea17 tempest-ProjectMemberTests-584998297 None] Lock "cinder-a728d255-deb1-429a-b838-dd42dc87a605-delete_snapshot" acquired by "delete_snapshot" :: waited 0.082s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-984f02d5-6032-40bb-9f93-35d69b9eea17 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a9218bd-cab4-451a-81d1-d7067c3d467a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-292893535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf52f70-6e1f-4d2f-8a51-1424588ef03e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee783b4cdea4e6cb2ac1f9c16155c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:30:28Z,use_quota=True,user_id='f7158827c0994f1ba079ebdc19eadcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daba6ccc-540f-499c-bd36-cb40a5d53dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daba6ccc-540f-499c-bd36-cb40a5d53dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aac6f2d-58d8-4a45-99db-dba561dd1c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aac6f2d-58d8-4a45-99db-dba561dd1c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cf52f70-6e1f-4d2f-8a51-1424588ef03e', 'volume_name': 'volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b5812e3-de0b-484f-8bfb-3b450ec357d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b5812e3-de0b-484f-8bfb-3b450ec357d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f93246-c86c-4ba4-b4b4-429257d5fa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:28 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Volume 2cf52f70-6e1f-4d2f-8a51-1424588ef03e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e', 'volume_size': 1} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-292893535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf52f70-6e1f-4d2f-8a51-1424588ef03e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee783b4cdea4e6cb2ac1f9c16155c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:30:28Z,use_quota=True,user_id='f7158827c0994f1ba079ebdc19eadcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Creating volume 2cf52f70-6e1f-4d2f-8a51-1424588ef03e {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:30:28 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-984f02d5-6032-40bb-9f93-35d69b9eea17 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2" acquired by "delete_snapshot" :: waited 0.091s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-984f02d5-6032-40bb-9f93-35d69b9eea17 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-a728d255-deb1-429a-b838-dd42dc87a605" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-984f02d5-6032-40bb-9f93-35d69b9eea17 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-a728d255-deb1-429a-b838-dd42dc87a605" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:28 devstack sudo[109061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e 1073741824 Sep 28 17:30:28 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-984f02d5-6032-40bb-9f93-35d69b9eea17 tempest-ProjectMemberTests-584998297 None] Deleting offline snapshot a728d255-deb1-429a-b838-dd42dc87a605 of volume 9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-984f02d5-6032-40bb-9f93-35d69b9eea17 tempest-ProjectMemberTests-584998297 None] snapshot_file for this snap is: volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.a728d255-deb1-429a-b838-dd42dc87a605 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[074db53d-50f1-4edd-932d-335b2eb70e16]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:28 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-984f02d5-6032-40bb-9f93-35d69b9eea17 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.a728d255-deb1-429a-b838-dd42dc87a605 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:28 devstack sudo[109063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.a728d255-deb1-429a-b838-dd42dc87a605 Sep 28 17:30:28 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:29 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e 1073741824" returned: 0 in 0.526s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:29 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-984f02d5-6032-40bb-9f93-35d69b9eea17 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.a728d255-deb1-429a-b838-dd42dc87a605" returned: 0 in 0.449s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-984f02d5-6032-40bb-9f93-35d69b9eea17 tempest-ProjectMemberTests-584998297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:30:29 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb2aeca-561e-438e-bd78-4bd77655f46a]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-984f02d5-6032-40bb-9f93-35d69b9eea17 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:29 devstack sudo[109073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e Sep 28 17:30:29 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:29 devstack sudo[109072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2 Sep 28 17:30:29 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:29 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e" returned: 0 in 0.294s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:30:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f93246-c86c-4ba4-b4b4-429257d5fa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f6c86e-1550-44db-a157-b02d88f3c37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:29 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Volume volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e (2cf52f70-6e1f-4d2f-8a51-1424588ef03e): created successfully Sep 28 17:30:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f6c86e-1550-44db-a157-b02d88f3c37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Flow 'volume_create_manager' (66c3c91c-d894-4bbc-9694-ee45896aadd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:30:29 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e03ff82a-21b8-4aad-9d15-e3d6cc2e87e1 tempest-ProjectReaderTests-948494610 None] Created volume successfully. Sep 28 17:30:29 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-984f02d5-6032-40bb-9f93-35d69b9eea17 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2" returned: 0 in 0.444s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-984f02d5-6032-40bb-9f93-35d69b9eea17 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.a728d255-deb1-429a-b838-dd42dc87a605 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:29 devstack sudo[109080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.a728d255-deb1-429a-b838-dd42dc87a605 Sep 28 17:30:29 devstack sudo[109080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:29 devstack sudo[109080]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-984f02d5-6032-40bb-9f93-35d69b9eea17 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.a728d255-deb1-429a-b838-dd42dc87a605" returned: 0 in 0.368s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-984f02d5-6032-40bb-9f93-35d69b9eea17 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.a728d255-deb1-429a-b838-dd42dc87a605 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:29 devstack sudo[109085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.a728d255-deb1-429a-b838-dd42dc87a605 Sep 28 17:30:29 devstack sudo[109085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:30 devstack sudo[109085]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-984f02d5-6032-40bb-9f93-35d69b9eea17 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2.a728d255-deb1-429a-b838-dd42dc87a605" returned: 0 in 0.288s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-984f02d5-6032-40bb-9f93-35d69b9eea17 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-a728d255-deb1-429a-b838-dd42dc87a605" released by "_delete_snapshot" :: held 1.683s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-984f02d5-6032-40bb-9f93-35d69b9eea17 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2" released by "delete_snapshot" :: held 1.714s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:30 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-984f02d5-6032-40bb-9f93-35d69b9eea17 tempest-ProjectMemberTests-584998297 None] Created reservations ['d8304f0c-c1a0-451f-9277-70ab0f09caaa', '2bcda909-a766-4c94-a291-bc764ce2c31b', '97bd988f-b9d5-49a3-8ff5-d60b3815bba0', '95553300-a087-4cff-85f9-1de2fbded1f2'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:30:30 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-984f02d5-6032-40bb-9f93-35d69b9eea17 tempest-ProjectMemberTests-584998297 None] Delete snapshot completed successfully. Sep 28 17:30:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-984f02d5-6032-40bb-9f93-35d69b9eea17 tempest-ProjectMemberTests-584998297 None] Lock "cinder-a728d255-deb1-429a-b838-dd42dc87a605-delete_snapshot" released by "delete_snapshot" :: held 1.933s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9ad6e6b3-4b27-40da-ae6d-2bc2903daeb3 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9ad6e6b3-4b27-40da-ae6d-2bc2903daeb3 tempest-ProjectMemberTests-584998297 None] Lock "cinder-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9ad6e6b3-4b27-40da-ae6d-2bc2903daeb3 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:30 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9ad6e6b3-4b27-40da-ae6d-2bc2903daeb3 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e10c9f16-3897-4bc5-9a6e-8beec5c29c65 tempest-ProjectReaderTests-948494610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e10c9f16-3897-4bc5-9a6e-8beec5c29c65 tempest-ProjectReaderTests-948494610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:30 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[243ecb34-b3cd-42b4-9b46-b5965cd84145]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ad6e6b3-4b27-40da-ae6d-2bc2903daeb3 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:30 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-e10c9f16-3897-4bc5-9a6e-8beec5c29c65 tempest-ProjectReaderTests-948494610 None] Creating offline snapshot b5acfc75-ab26-430d-8879-2544fdb21c06 of volume 2cf52f70-6e1f-4d2f-8a51-1424588ef03e {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:30:30 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48173b9-bb01-4fc7-8462-3e5830a208f1]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e10c9f16-3897-4bc5-9a6e-8beec5c29c65 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:30 devstack sudo[109088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2 Sep 28 17:30:30 devstack sudo[109088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:30 devstack sudo[109089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e Sep 28 17:30:30 devstack sudo[109089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:31 devstack sudo[109088]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ad6e6b3-4b27-40da-ae6d-2bc2903daeb3 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2" returned: 0 in 0.379s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ad6e6b3-4b27-40da-ae6d-2bc2903daeb3 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:31 devstack sudo[109098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2 Sep 28 17:30:31 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:31 devstack sudo[109089]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e10c9f16-3897-4bc5-9a6e-8beec5c29c65 tempest-ProjectReaderTests-948494610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e" returned: 0 in 0.386s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e10c9f16-3897-4bc5-9a6e-8beec5c29c65 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.b5acfc75-ab26-430d-8879-2544fdb21c06 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:31 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.b5acfc75-ab26-430d-8879-2544fdb21c06 1G Sep 28 17:30:31 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:31 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ad6e6b3-4b27-40da-ae6d-2bc2903daeb3 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2" returned: 0 in 0.255s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9ad6e6b3-4b27-40da-ae6d-2bc2903daeb3 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2" released by "delete_volume" :: held 0.703s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:31 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-9ad6e6b3-4b27-40da-ae6d-2bc2903daeb3 tempest-ProjectMemberTests-584998297 None] Created reservations ['558460cf-0e00-40c4-bcca-16b2a1110408', '460fc05c-4ce7-481e-a76d-643535cab90c', '02611034-e7bb-47e2-b998-77912c063219', '6acfbdbb-f826-4efd-a6e4-42cb1f7cda6c'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:30:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9ad6e6b3-4b27-40da-ae6d-2bc2903daeb3 tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9ad6e6b3-4b27-40da-ae6d-2bc2903daeb3 tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:31 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9ad6e6b3-4b27-40da-ae6d-2bc2903daeb3 tempest-ProjectMemberTests-584998297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:31 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9ad6e6b3-4b27-40da-ae6d-2bc2903daeb3 tempest-ProjectMemberTests-584998297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9ad6e6b3-4b27-40da-ae6d-2bc2903daeb3 tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ad6e6b3-4b27-40da-ae6d-2bc2903daeb3 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:31 devstack sudo[109107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:30:31 devstack sudo[109107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:31 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e10c9f16-3897-4bc5-9a6e-8beec5c29c65 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.b5acfc75-ab26-430d-8879-2544fdb21c06 1G" returned: 0 in 0.421s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e10c9f16-3897-4bc5-9a6e-8beec5c29c65 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.b5acfc75-ab26-430d-8879-2544fdb21c06 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:31 devstack sudo[109109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.b5acfc75-ab26-430d-8879-2544fdb21c06 Sep 28 17:30:31 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:31 devstack sudo[109107]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9ad6e6b3-4b27-40da-ae6d-2bc2903daeb3 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.279s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:31 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-9ad6e6b3-4b27-40da-ae6d-2bc2903daeb3 tempest-ProjectMemberTests-584998297 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:30:31 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-9ad6e6b3-4b27-40da-ae6d-2bc2903daeb3 tempest-ProjectMemberTests-584998297 None] Deleted volume successfully. Sep 28 17:30:31 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-9ad6e6b3-4b27-40da-ae6d-2bc2903daeb3 tempest-ProjectMemberTests-584998297 None] Lock "cinder-9ddd83e7-d06b-4629-8b3b-0ac2e7c490c2-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:31 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e10c9f16-3897-4bc5-9a6e-8beec5c29c65 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.b5acfc75-ab26-430d-8879-2544fdb21c06" returned: 0 in 0.336s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:31 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-e10c9f16-3897-4bc5-9a6e-8beec5c29c65 tempest-ProjectReaderTests-948494610 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.b5acfc75-ab26-430d-8879-2544fdb21c06 is being set with open permissions: ugo+rw Sep 28 17:30:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e10c9f16-3897-4bc5-9a6e-8beec5c29c65 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.b5acfc75-ab26-430d-8879-2544fdb21c06 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:31 devstack sudo[109115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.b5acfc75-ab26-430d-8879-2544fdb21c06 Sep 28 17:30:31 devstack sudo[109115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:32 devstack sudo[109115]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e10c9f16-3897-4bc5-9a6e-8beec5c29c65 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.b5acfc75-ab26-430d-8879-2544fdb21c06" returned: 0 in 0.261s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e10c9f16-3897-4bc5-9a6e-8beec5c29c65 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:32 devstack sudo[109118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.info Sep 28 17:30:32 devstack sudo[109118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Flow 'volume_create_manager' (9016b688-f748-4eca-a317-c3a02450fda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (540e8753-d8de-478e-9699-f0b4948a30c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (540e8753-d8de-478e-9699-f0b4948a30c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1085347952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7249c3d3-f44f-477b-8ac4-a9a60e985f72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716b289f0179458f8e2e869e7ff71485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:30:32Z,use_quota=True,user_id='ccaca5bfad8b4b96b2ae3b66012f813b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc52a19e-b489-44d0-a9ed-fcc17b352ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc52a19e-b489-44d0-a9ed-fcc17b352ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2442574-b948-4252-b3e7-10b48f2fc4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2442574-b948-4252-b3e7-10b48f2fc4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7249c3d3-f44f-477b-8ac4-a9a60e985f72', 'volume_name': 'volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b40b859-7112-4b0b-9bd9-2cd38975fc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b40b859-7112-4b0b-9bd9-2cd38975fc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (728dde76-bec0-4ca1-9886-454028a7cb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:32 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Volume 7249c3d3-f44f-477b-8ac4-a9a60e985f72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72', 'volume_size': 1} Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:32 devstack sudo[109118]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e10c9f16-3897-4bc5-9a6e-8beec5c29c65 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.info" returned: 0 in 0.270s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:32 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-e10c9f16-3897-4bc5-9a6e-8beec5c29c65 tempest-ProjectReaderTests-948494610 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.info is being set with open permissions: ugo+rw Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e10c9f16-3897-4bc5-9a6e-8beec5c29c65 tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:32 devstack sudo[109121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.info Sep 28 17:30:32 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:32 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e10c9f16-3897-4bc5-9a6e-8beec5c29c65 tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.info" returned: 0 in 0.252s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e10c9f16-3897-4bc5-9a6e-8beec5c29c65 tempest-ProjectReaderTests-948494610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.028s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.382s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1085347952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7249c3d3-f44f-477b-8ac4-a9a60e985f72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='716b289f0179458f8e2e869e7ff71485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:30:32Z,use_quota=True,user_id='ccaca5bfad8b4b96b2ae3b66012f813b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Creating volume 7249c3d3-f44f-477b-8ac4-a9a60e985f72 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:30:32 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:30:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:32 devstack sudo[109124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72 1073741824 Sep 28 17:30:32 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:32 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e10c9f16-3897-4bc5-9a6e-8beec5c29c65 tempest-ProjectReaderTests-948494610 None] Create snapshot completed successfully Sep 28 17:30:33 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72 1073741824" returned: 0 in 0.436s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:33 devstack sudo[109129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72 Sep 28 17:30:33 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:33 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72" returned: 0 in 0.235s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:33 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:30:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (728dde76-bec0-4ca1-9886-454028a7cb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f583777-b3d7-4e05-b52b-67f492b1d249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:33 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Volume volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72 (7249c3d3-f44f-477b-8ac4-a9a60e985f72): created successfully Sep 28 17:30:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f583777-b3d7-4e05-b52b-67f492b1d249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Flow 'volume_create_manager' (9016b688-f748-4eca-a317-c3a02450fda5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:30:33 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-9a45c8fc-8ae4-4182-94ef-234389d63d7e tempest-ProjectMemberTests-584998297 None] Created volume successfully. Sep 28 17:30:33 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1516a883-ff0a-4b44-ad4d-e4ba7176436d tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-b5acfc75-ab26-430d-8879-2544fdb21c06-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:33 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1516a883-ff0a-4b44-ad4d-e4ba7176436d tempest-ProjectReaderTests-948494610 None] Lock "cinder-b5acfc75-ab26-430d-8879-2544fdb21c06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:33 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1516a883-ff0a-4b44-ad4d-e4ba7176436d tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-quobyte-2cf52f70-6e1f-4d2f-8a51-1424588ef03e" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:33 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1516a883-ff0a-4b44-ad4d-e4ba7176436d tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-2cf52f70-6e1f-4d2f-8a51-1424588ef03e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:33 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1516a883-ff0a-4b44-ad4d-e4ba7176436d tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-quobyte-b5acfc75-ab26-430d-8879-2544fdb21c06" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:33 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1516a883-ff0a-4b44-ad4d-e4ba7176436d tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-b5acfc75-ab26-430d-8879-2544fdb21c06" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:33 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-1516a883-ff0a-4b44-ad4d-e4ba7176436d tempest-ProjectReaderTests-948494610 None] Deleting offline snapshot b5acfc75-ab26-430d-8879-2544fdb21c06 of volume 2cf52f70-6e1f-4d2f-8a51-1424588ef03e {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:30:33 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-1516a883-ff0a-4b44-ad4d-e4ba7176436d tempest-ProjectReaderTests-948494610 None] snapshot_file for this snap is: volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.b5acfc75-ab26-430d-8879-2544fdb21c06 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:30:33 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[8708d52c-f67f-4208-a6e4-60f9312064d6]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1516a883-ff0a-4b44-ad4d-e4ba7176436d tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.b5acfc75-ab26-430d-8879-2544fdb21c06 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:34 devstack sudo[109132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.b5acfc75-ab26-430d-8879-2544fdb21c06 Sep 28 17:30:34 devstack sudo[109132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:34 devstack sudo[109132]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1516a883-ff0a-4b44-ad4d-e4ba7176436d tempest-ProjectReaderTests-948494610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.b5acfc75-ab26-430d-8879-2544fdb21c06" returned: 0 in 0.413s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-1516a883-ff0a-4b44-ad4d-e4ba7176436d tempest-ProjectReaderTests-948494610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:30:34 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c15fd09-22ec-4b19-800b-95d9d134860f]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1516a883-ff0a-4b44-ad4d-e4ba7176436d tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:34 devstack sudo[109138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e Sep 28 17:30:34 devstack sudo[109138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5ee778c3-6cca-499a-8a34-dbcd94b6c9c8 tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5ee778c3-6cca-499a-8a34-dbcd94b6c9c8 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:34 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-5ee778c3-6cca-499a-8a34-dbcd94b6c9c8 tempest-ProjectMemberTests-584998297 None] Creating offline snapshot 8101e8ff-08b5-45e8-b410-ab0ef906f7e4 of volume 7249c3d3-f44f-477b-8ac4-a9a60e985f72 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:30:34 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4ed6bc-b637-4fc6-b8d3-024ecedcca73]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ee778c3-6cca-499a-8a34-dbcd94b6c9c8 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:34 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72 Sep 28 17:30:34 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:34 devstack sudo[109138]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1516a883-ff0a-4b44-ad4d-e4ba7176436d tempest-ProjectReaderTests-948494610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e" returned: 0 in 0.389s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:34 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1516a883-ff0a-4b44-ad4d-e4ba7176436d tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.b5acfc75-ab26-430d-8879-2544fdb21c06 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:34 devstack sudo[109146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.b5acfc75-ab26-430d-8879-2544fdb21c06 Sep 28 17:30:34 devstack sudo[109146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:35 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ee778c3-6cca-499a-8a34-dbcd94b6c9c8 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72" returned: 0 in 0.412s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ee778c3-6cca-499a-8a34-dbcd94b6c9c8 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.8101e8ff-08b5-45e8-b410-ab0ef906f7e4 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:35 devstack sudo[109153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.8101e8ff-08b5-45e8-b410-ab0ef906f7e4 1G Sep 28 17:30:35 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:35 devstack sudo[109146]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1516a883-ff0a-4b44-ad4d-e4ba7176436d tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.b5acfc75-ab26-430d-8879-2544fdb21c06" returned: 0 in 0.403s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1516a883-ff0a-4b44-ad4d-e4ba7176436d tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.b5acfc75-ab26-430d-8879-2544fdb21c06 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:35 devstack sudo[109156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.b5acfc75-ab26-430d-8879-2544fdb21c06 Sep 28 17:30:35 devstack sudo[109156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:35 devstack sudo[109156]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1516a883-ff0a-4b44-ad4d-e4ba7176436d tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e.b5acfc75-ab26-430d-8879-2544fdb21c06" returned: 0 in 0.266s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:35 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ee778c3-6cca-499a-8a34-dbcd94b6c9c8 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.8101e8ff-08b5-45e8-b410-ab0ef906f7e4 1G" returned: 0 in 0.451s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ee778c3-6cca-499a-8a34-dbcd94b6c9c8 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.8101e8ff-08b5-45e8-b410-ab0ef906f7e4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:35 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1516a883-ff0a-4b44-ad4d-e4ba7176436d tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-b5acfc75-ab26-430d-8879-2544fdb21c06" released by "_delete_snapshot" :: held 1.589s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:35 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1516a883-ff0a-4b44-ad4d-e4ba7176436d tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-2cf52f70-6e1f-4d2f-8a51-1424588ef03e" released by "delete_snapshot" :: held 1.612s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:35 devstack sudo[109162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.8101e8ff-08b5-45e8-b410-ab0ef906f7e4 Sep 28 17:30:35 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:35 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-1516a883-ff0a-4b44-ad4d-e4ba7176436d tempest-ProjectReaderTests-948494610 None] Created reservations ['3f0eedd6-af16-4b3d-92e9-db6bc1ca556b', '2408b21c-6ce8-4b94-ab2a-4079aafee709', '319b172d-64bf-487a-b41f-6d5c15f0d461', '3790ab19-60b4-475f-bb69-6c8c24062921'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:30:35 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-1516a883-ff0a-4b44-ad4d-e4ba7176436d tempest-ProjectReaderTests-948494610 None] Delete snapshot completed successfully. Sep 28 17:30:35 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1516a883-ff0a-4b44-ad4d-e4ba7176436d tempest-ProjectReaderTests-948494610 None] Lock "cinder-b5acfc75-ab26-430d-8879-2544fdb21c06-delete_snapshot" released by "delete_snapshot" :: held 1.758s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:35 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ee778c3-6cca-499a-8a34-dbcd94b6c9c8 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.8101e8ff-08b5-45e8-b410-ab0ef906f7e4" returned: 0 in 0.298s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:35 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-5ee778c3-6cca-499a-8a34-dbcd94b6c9c8 tempest-ProjectMemberTests-584998297 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.8101e8ff-08b5-45e8-b410-ab0ef906f7e4 is being set with open permissions: ugo+rw Sep 28 17:30:35 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ee778c3-6cca-499a-8a34-dbcd94b6c9c8 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.8101e8ff-08b5-45e8-b410-ab0ef906f7e4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:35 devstack sudo[109167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.8101e8ff-08b5-45e8-b410-ab0ef906f7e4 Sep 28 17:30:35 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-00e5e61a-0965-4fc5-80de-b58ab5acb3fa tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-2cf52f70-6e1f-4d2f-8a51-1424588ef03e-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:36 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-00e5e61a-0965-4fc5-80de-b58ab5acb3fa tempest-ProjectReaderTests-948494610 None] Lock "cinder-2cf52f70-6e1f-4d2f-8a51-1424588ef03e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ee778c3-6cca-499a-8a34-dbcd94b6c9c8 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.8101e8ff-08b5-45e8-b410-ab0ef906f7e4" returned: 0 in 0.285s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ee778c3-6cca-499a-8a34-dbcd94b6c9c8 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-00e5e61a-0965-4fc5-80de-b58ab5acb3fa tempest-ProjectReaderTests-948494610 None] Acquiring lock "cinder-quobyte-2cf52f70-6e1f-4d2f-8a51-1424588ef03e" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:36 devstack sudo[109170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.info Sep 28 17:30:36 devstack sudo[109170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-00e5e61a-0965-4fc5-80de-b58ab5acb3fa tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-2cf52f70-6e1f-4d2f-8a51-1424588ef03e" acquired by "delete_volume" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15d686e-4e7b-4c7c-9e8f-50e755cd7bd0]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-00e5e61a-0965-4fc5-80de-b58ab5acb3fa tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:36 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e Sep 28 17:30:36 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:36 devstack sudo[109170]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ee778c3-6cca-499a-8a34-dbcd94b6c9c8 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.info" returned: 0 in 0.260s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:36 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-5ee778c3-6cca-499a-8a34-dbcd94b6c9c8 tempest-ProjectMemberTests-584998297 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.info is being set with open permissions: ugo+rw Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ee778c3-6cca-499a-8a34-dbcd94b6c9c8 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:36 devstack sudo[109175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.info Sep 28 17:30:36 devstack sudo[109175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:36 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-00e5e61a-0965-4fc5-80de-b58ab5acb3fa tempest-ProjectReaderTests-948494610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e" returned: 0 in 0.378s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-00e5e61a-0965-4fc5-80de-b58ab5acb3fa tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:36 devstack sudo[109181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e Sep 28 17:30:36 devstack sudo[109181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:36 devstack sudo[109175]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-5ee778c3-6cca-499a-8a34-dbcd94b6c9c8 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.info" returned: 0 in 0.263s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-5ee778c3-6cca-499a-8a34-dbcd94b6c9c8 tempest-ProjectMemberTests-584998297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.073s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:36 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-5ee778c3-6cca-499a-8a34-dbcd94b6c9c8 tempest-ProjectMemberTests-584998297 None] Create snapshot completed successfully Sep 28 17:30:36 devstack sudo[109181]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-00e5e61a-0965-4fc5-80de-b58ab5acb3fa tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2cf52f70-6e1f-4d2f-8a51-1424588ef03e" returned: 0 in 0.273s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-00e5e61a-0965-4fc5-80de-b58ab5acb3fa tempest-ProjectReaderTests-948494610 None] Lock "cinder-quobyte-2cf52f70-6e1f-4d2f-8a51-1424588ef03e" released by "delete_volume" :: held 0.715s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-00e5e61a-0965-4fc5-80de-b58ab5acb3fa tempest-ProjectReaderTests-948494610 None] Created reservations ['7a49ebb7-5cb8-4855-99c0-3f5d03846bf4', '27bc4134-a8e1-4d4a-91dd-51ea07483b8b', '74ee72e3-e909-4a64-9d2f-7f22c0c34b34', 'c9b0b89b-ae1f-4cd4-9faa-3fc4d5ea8ddb'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-00e5e61a-0965-4fc5-80de-b58ab5acb3fa tempest-ProjectReaderTests-948494610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-00e5e61a-0965-4fc5-80de-b58ab5acb3fa tempest-ProjectReaderTests-948494610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-00e5e61a-0965-4fc5-80de-b58ab5acb3fa tempest-ProjectReaderTests-948494610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-00e5e61a-0965-4fc5-80de-b58ab5acb3fa tempest-ProjectReaderTests-948494610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-00e5e61a-0965-4fc5-80de-b58ab5acb3fa tempest-ProjectReaderTests-948494610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:36 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-00e5e61a-0965-4fc5-80de-b58ab5acb3fa tempest-ProjectReaderTests-948494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:36 devstack sudo[109184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:30:36 devstack sudo[109184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:37 devstack sudo[109184]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-00e5e61a-0965-4fc5-80de-b58ab5acb3fa tempest-ProjectReaderTests-948494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.277s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:37 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-00e5e61a-0965-4fc5-80de-b58ab5acb3fa tempest-ProjectReaderTests-948494610 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:30:37 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-00e5e61a-0965-4fc5-80de-b58ab5acb3fa tempest-ProjectReaderTests-948494610 None] Deleted volume successfully. Sep 28 17:30:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-00e5e61a-0965-4fc5-80de-b58ab5acb3fa tempest-ProjectReaderTests-948494610 None] Lock "cinder-2cf52f70-6e1f-4d2f-8a51-1424588ef03e-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-13521a6e-edfd-424f-bd2a-f0c392178949 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-8101e8ff-08b5-45e8-b410-ab0ef906f7e4-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-13521a6e-edfd-424f-bd2a-f0c392178949 tempest-ProjectMemberTests-584998297 None] Lock "cinder-8101e8ff-08b5-45e8-b410-ab0ef906f7e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-13521a6e-edfd-424f-bd2a-f0c392178949 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-7249c3d3-f44f-477b-8ac4-a9a60e985f72" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-13521a6e-edfd-424f-bd2a-f0c392178949 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-7249c3d3-f44f-477b-8ac4-a9a60e985f72" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-13521a6e-edfd-424f-bd2a-f0c392178949 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-8101e8ff-08b5-45e8-b410-ab0ef906f7e4" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:37 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-13521a6e-edfd-424f-bd2a-f0c392178949 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-8101e8ff-08b5-45e8-b410-ab0ef906f7e4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-13521a6e-edfd-424f-bd2a-f0c392178949 tempest-ProjectMemberTests-584998297 None] Deleting offline snapshot 8101e8ff-08b5-45e8-b410-ab0ef906f7e4 of volume 7249c3d3-f44f-477b-8ac4-a9a60e985f72 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:30:37 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-13521a6e-edfd-424f-bd2a-f0c392178949 tempest-ProjectMemberTests-584998297 None] snapshot_file for this snap is: volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.8101e8ff-08b5-45e8-b410-ab0ef906f7e4 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:30:37 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9ee7cb-d9c0-4e07-aedf-48c5d9dcedb7]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:37 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-13521a6e-edfd-424f-bd2a-f0c392178949 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.8101e8ff-08b5-45e8-b410-ab0ef906f7e4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:38 devstack sudo[109187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.8101e8ff-08b5-45e8-b410-ab0ef906f7e4 Sep 28 17:30:38 devstack sudo[109187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:38 devstack sudo[109187]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-13521a6e-edfd-424f-bd2a-f0c392178949 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.8101e8ff-08b5-45e8-b410-ab0ef906f7e4" returned: 0 in 0.390s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:38 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-13521a6e-edfd-424f-bd2a-f0c392178949 tempest-ProjectMemberTests-584998297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:30:38 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced54aa4-281b-47d9-8adb-a334ce90d3a8]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-13521a6e-edfd-424f-bd2a-f0c392178949 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:38 devstack sudo[109192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72 Sep 28 17:30:38 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:38 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-13521a6e-edfd-424f-bd2a-f0c392178949 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72" returned: 0 in 0.384s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:38 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-13521a6e-edfd-424f-bd2a-f0c392178949 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.8101e8ff-08b5-45e8-b410-ab0ef906f7e4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:38 devstack sudo[109197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.8101e8ff-08b5-45e8-b410-ab0ef906f7e4 Sep 28 17:30:38 devstack sudo[109197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:39 devstack sudo[109197]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-13521a6e-edfd-424f-bd2a-f0c392178949 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.8101e8ff-08b5-45e8-b410-ab0ef906f7e4" returned: 0 in 0.369s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-13521a6e-edfd-424f-bd2a-f0c392178949 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.8101e8ff-08b5-45e8-b410-ab0ef906f7e4 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:39 devstack sudo[109202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.8101e8ff-08b5-45e8-b410-ab0ef906f7e4 Sep 28 17:30:39 devstack sudo[109202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:39 devstack sudo[109202]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-13521a6e-edfd-424f-bd2a-f0c392178949 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72.8101e8ff-08b5-45e8-b410-ab0ef906f7e4" returned: 0 in 0.265s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-13521a6e-edfd-424f-bd2a-f0c392178949 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-8101e8ff-08b5-45e8-b410-ab0ef906f7e4" released by "_delete_snapshot" :: held 1.532s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-13521a6e-edfd-424f-bd2a-f0c392178949 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-7249c3d3-f44f-477b-8ac4-a9a60e985f72" released by "delete_snapshot" :: held 1.555s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:39 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-13521a6e-edfd-424f-bd2a-f0c392178949 tempest-ProjectMemberTests-584998297 None] Created reservations ['50de2a1b-498c-4f98-aa02-94bd98b2b460', '0a67f397-48fb-4925-b3a7-3698a08a76e1', '4fd66cb0-89d5-452b-b302-bfe7c3b36972', 'a66df110-a0cc-4758-ac7f-b8e320486a2b'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:30:39 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-13521a6e-edfd-424f-bd2a-f0c392178949 tempest-ProjectMemberTests-584998297 None] Delete snapshot completed successfully. Sep 28 17:30:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-13521a6e-edfd-424f-bd2a-f0c392178949 tempest-ProjectMemberTests-584998297 None] Lock "cinder-8101e8ff-08b5-45e8-b410-ab0ef906f7e4-delete_snapshot" released by "delete_snapshot" :: held 1.704s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0d2332b4-a2f3-4165-91b4-9c5f1aabbfe2 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-7249c3d3-f44f-477b-8ac4-a9a60e985f72-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0d2332b4-a2f3-4165-91b4-9c5f1aabbfe2 tempest-ProjectMemberTests-584998297 None] Lock "cinder-7249c3d3-f44f-477b-8ac4-a9a60e985f72-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0d2332b4-a2f3-4165-91b4-9c5f1aabbfe2 tempest-ProjectMemberTests-584998297 None] Acquiring lock "cinder-quobyte-7249c3d3-f44f-477b-8ac4-a9a60e985f72" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0d2332b4-a2f3-4165-91b4-9c5f1aabbfe2 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-7249c3d3-f44f-477b-8ac4-a9a60e985f72" acquired by "delete_volume" :: waited 0.019s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:40 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd83cfd-1300-42f9-98af-5853a2a03e02]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0d2332b4-a2f3-4165-91b4-9c5f1aabbfe2 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:40 devstack sudo[109205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72 Sep 28 17:30:40 devstack sudo[109205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:40 devstack sudo[109205]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0d2332b4-a2f3-4165-91b4-9c5f1aabbfe2 tempest-ProjectMemberTests-584998297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72" returned: 0 in 0.410s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0d2332b4-a2f3-4165-91b4-9c5f1aabbfe2 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:40 devstack sudo[109211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72 Sep 28 17:30:40 devstack sudo[109211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:40 devstack sudo[109211]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0d2332b4-a2f3-4165-91b4-9c5f1aabbfe2 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-7249c3d3-f44f-477b-8ac4-a9a60e985f72" returned: 0 in 0.292s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0d2332b4-a2f3-4165-91b4-9c5f1aabbfe2 tempest-ProjectMemberTests-584998297 None] Lock "cinder-quobyte-7249c3d3-f44f-477b-8ac4-a9a60e985f72" released by "delete_volume" :: held 0.781s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:40 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-0d2332b4-a2f3-4165-91b4-9c5f1aabbfe2 tempest-ProjectMemberTests-584998297 None] Created reservations ['bc0a4464-cdae-41ee-8cd0-d673ed1242c9', '4a103972-6590-43c8-8039-a66551343d88', 'fd713a7b-5a86-47c4-81e8-940f516f4218', '226f602f-e64c-4b10-bed2-a711d6281a71'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:30:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0d2332b4-a2f3-4165-91b4-9c5f1aabbfe2 tempest-ProjectMemberTests-584998297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0d2332b4-a2f3-4165-91b4-9c5f1aabbfe2 tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0d2332b4-a2f3-4165-91b4-9c5f1aabbfe2 tempest-ProjectMemberTests-584998297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-0d2332b4-a2f3-4165-91b4-9c5f1aabbfe2 tempest-ProjectMemberTests-584998297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-0d2332b4-a2f3-4165-91b4-9c5f1aabbfe2 tempest-ProjectMemberTests-584998297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0d2332b4-a2f3-4165-91b4-9c5f1aabbfe2 tempest-ProjectMemberTests-584998297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:41 devstack sudo[109214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:30:41 devstack sudo[109214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:41 devstack sudo[109214]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-0d2332b4-a2f3-4165-91b4-9c5f1aabbfe2 tempest-ProjectMemberTests-584998297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.287s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:41 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-0d2332b4-a2f3-4165-91b4-9c5f1aabbfe2 tempest-ProjectMemberTests-584998297 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:30:41 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-0d2332b4-a2f3-4165-91b4-9c5f1aabbfe2 tempest-ProjectMemberTests-584998297 None] Deleted volume successfully. Sep 28 17:30:41 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-0d2332b4-a2f3-4165-91b4-9c5f1aabbfe2 tempest-ProjectMemberTests-584998297 None] Lock "cinder-7249c3d3-f44f-477b-8ac4-a9a60e985f72-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:51 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:UPDATE=54,cinder:SELECT=38,cinder:DELETE=5,cinder:INSERT=13 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:30:52 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=37,cinder:INSERT=15,cinder:UPDATE=45,cinder:DELETE=2 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:30:57 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:30:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Flow 'volume_create_manager' (fe299ab6-656e-429c-a82a-52b68855de72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:30:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83181061-bb40-4273-8dbe-550f3370a76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83181061-bb40-4273-8dbe-550f3370a76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2023399976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c920565b-f040-425c-b324-0983820acf86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05582c0d63a94f5488e18e4223ceadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:30:56Z,use_quota=True,user_id='09a50f9fe1f2451b88f61a97c176bb6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b776de0-7d4b-4013-bd27-0d598ddc08e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b776de0-7d4b-4013-bd27-0d598ddc08e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee087b9-1aef-4491-b37d-539e6741403f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee087b9-1aef-4491-b37d-539e6741403f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c920565b-f040-425c-b324-0983820acf86', 'volume_name': 'volume-c920565b-f040-425c-b324-0983820acf86', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b49570-1fb0-4119-8fdc-ed61d5f3ea0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b49570-1fb0-4119-8fdc-ed61d5f3ea0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:57 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a651fdde-edeb-4a62-8f8e-492326e87741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:57 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Volume c920565b-f040-425c-b324-0983820acf86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c920565b-f040-425c-b324-0983820acf86', 'volume_size': 1} Sep 28 17:30:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2023399976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c920565b-f040-425c-b324-0983820acf86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05582c0d63a94f5488e18e4223ceadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:30:56Z,use_quota=True,user_id='09a50f9fe1f2451b88f61a97c176bb6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:30:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Creating volume c920565b-f040-425c-b324-0983820acf86 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:30:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:57 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:30:57 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:30:57 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c920565b-f040-425c-b324-0983820acf86 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:57 devstack sudo[109220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c920565b-f040-425c-b324-0983820acf86 1073741824 Sep 28 17:30:57 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:58 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:58 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c920565b-f040-425c-b324-0983820acf86 1073741824" returned: 0 in 0.404s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c920565b-f040-425c-b324-0983820acf86 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:59 devstack sudo[109226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c920565b-f040-425c-b324-0983820acf86 Sep 28 17:30:59 devstack sudo[109226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:59 devstack sudo[109226]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c920565b-f040-425c-b324-0983820acf86" returned: 0 in 0.300s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:59 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:30:59 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a651fdde-edeb-4a62-8f8e-492326e87741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c920565b-f040-425c-b324-0983820acf86', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc0d0285-f49b-4f25-896c-5933ed3ca036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:59 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Volume volume-c920565b-f040-425c-b324-0983820acf86 (c920565b-f040-425c-b324-0983820acf86): created successfully Sep 28 17:30:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc0d0285-f49b-4f25-896c-5933ed3ca036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:59 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Flow 'volume_create_manager' (fe299ab6-656e-429c-a82a-52b68855de72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:30:59 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-9bb99114-03f8-466a-b73d-d851a91518e9 tempest-ProjectReaderTests-418115774 None] Created volume successfully. Sep 28 17:31:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8fa03faa-2fac-42ed-a11e-b6ed4309b503 tempest-ProjectReaderTests-418115774 None] Acquiring lock "cinder-c920565b-f040-425c-b324-0983820acf86-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8fa03faa-2fac-42ed-a11e-b6ed4309b503 tempest-ProjectReaderTests-418115774 None] Lock "cinder-c920565b-f040-425c-b324-0983820acf86-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8fa03faa-2fac-42ed-a11e-b6ed4309b503 tempest-ProjectReaderTests-418115774 None] Acquiring lock "cinder-quobyte-c920565b-f040-425c-b324-0983820acf86" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8fa03faa-2fac-42ed-a11e-b6ed4309b503 tempest-ProjectReaderTests-418115774 None] Lock "cinder-quobyte-c920565b-f040-425c-b324-0983820acf86" acquired by "delete_volume" :: waited 0.025s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:00 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad89ab3c-95e1-4bfe-9cbf-c839745db28c]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8fa03faa-2fac-42ed-a11e-b6ed4309b503 tempest-ProjectReaderTests-418115774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c920565b-f040-425c-b324-0983820acf86 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:00 devstack sudo[109230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c920565b-f040-425c-b324-0983820acf86 Sep 28 17:31:00 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:00 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8fa03faa-2fac-42ed-a11e-b6ed4309b503 tempest-ProjectReaderTests-418115774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c920565b-f040-425c-b324-0983820acf86" returned: 0 in 0.436s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8fa03faa-2fac-42ed-a11e-b6ed4309b503 tempest-ProjectReaderTests-418115774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c920565b-f040-425c-b324-0983820acf86 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:00 devstack sudo[109236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c920565b-f040-425c-b324-0983820acf86 Sep 28 17:31:00 devstack sudo[109236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:00 devstack sudo[109236]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8fa03faa-2fac-42ed-a11e-b6ed4309b503 tempest-ProjectReaderTests-418115774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-c920565b-f040-425c-b324-0983820acf86" returned: 0 in 0.259s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:00 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8fa03faa-2fac-42ed-a11e-b6ed4309b503 tempest-ProjectReaderTests-418115774 None] Lock "cinder-quobyte-c920565b-f040-425c-b324-0983820acf86" released by "delete_volume" :: held 0.751s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:00 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-8fa03faa-2fac-42ed-a11e-b6ed4309b503 tempest-ProjectReaderTests-418115774 None] Created reservations ['c182cc6b-3524-48ce-9aa0-604d0fbe335d', '947cad71-40a0-4963-a952-ae294282caec', 'c34f1a29-63c7-444e-b548-00581b420ea5', '6af1b134-fc49-4647-8833-257d96a5bdf7'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8fa03faa-2fac-42ed-a11e-b6ed4309b503 tempest-ProjectReaderTests-418115774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8fa03faa-2fac-42ed-a11e-b6ed4309b503 tempest-ProjectReaderTests-418115774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8fa03faa-2fac-42ed-a11e-b6ed4309b503 tempest-ProjectReaderTests-418115774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:00 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-8fa03faa-2fac-42ed-a11e-b6ed4309b503 tempest-ProjectReaderTests-418115774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-8fa03faa-2fac-42ed-a11e-b6ed4309b503 tempest-ProjectReaderTests-418115774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:00 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8fa03faa-2fac-42ed-a11e-b6ed4309b503 tempest-ProjectReaderTests-418115774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:01 devstack sudo[109239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:31:01 devstack sudo[109239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:01 devstack sudo[109239]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-8fa03faa-2fac-42ed-a11e-b6ed4309b503 tempest-ProjectReaderTests-418115774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.329s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-8fa03faa-2fac-42ed-a11e-b6ed4309b503 tempest-ProjectReaderTests-418115774 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:01 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-8fa03faa-2fac-42ed-a11e-b6ed4309b503 tempest-ProjectReaderTests-418115774 None] Deleted volume successfully. Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-8fa03faa-2fac-42ed-a11e-b6ed4309b503 tempest-ProjectReaderTests-418115774 None] Lock "cinder-c920565b-f040-425c-b324-0983820acf86-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Flow 'volume_create_manager' (8d8f7d1f-09ce-4c75-a130-ef077eadaa20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4944e4a-fd9f-4621-8bdf-75b11a8e53d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4944e4a-fd9f-4621-8bdf-75b11a8e53d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2090761666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f65e5b8-2ff8-4855-9098-4ada6fd30508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05582c0d63a94f5488e18e4223ceadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:02Z,use_quota=True,user_id='09a50f9fe1f2451b88f61a97c176bb6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457df963-8589-4408-b21c-d738b23e80a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457df963-8589-4408-b21c-d738b23e80a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7fd5a26-ff7a-440c-9eed-0c637ba4cf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7fd5a26-ff7a-440c-9eed-0c637ba4cf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f65e5b8-2ff8-4855-9098-4ada6fd30508', 'volume_name': 'volume-2f65e5b8-2ff8-4855-9098-4ada6fd30508', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9474f148-fbcc-4125-b121-310ee81661bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9474f148-fbcc-4125-b121-310ee81661bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9954330d-2ead-4a9c-a5e3-d27f6aede476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:01 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Volume 2f65e5b8-2ff8-4855-9098-4ada6fd30508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f65e5b8-2ff8-4855-9098-4ada6fd30508', 'volume_size': 1} Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2090761666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f65e5b8-2ff8-4855-9098-4ada6fd30508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05582c0d63a94f5488e18e4223ceadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:02Z,use_quota=True,user_id='09a50f9fe1f2451b88f61a97c176bb6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Creating volume 2f65e5b8-2ff8-4855-9098-4ada6fd30508 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:01 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:31:01 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2f65e5b8-2ff8-4855-9098-4ada6fd30508 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:01 devstack sudo[109242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2f65e5b8-2ff8-4855-9098-4ada6fd30508 1073741824 Sep 28 17:31:01 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:02 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2f65e5b8-2ff8-4855-9098-4ada6fd30508 1073741824" returned: 0 in 0.502s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2f65e5b8-2ff8-4855-9098-4ada6fd30508 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:02 devstack sudo[109248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2f65e5b8-2ff8-4855-9098-4ada6fd30508 Sep 28 17:31:02 devstack sudo[109248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:02 devstack sudo[109248]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2f65e5b8-2ff8-4855-9098-4ada6fd30508" returned: 0 in 0.263s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:02 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:02 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9954330d-2ead-4a9c-a5e3-d27f6aede476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f65e5b8-2ff8-4855-9098-4ada6fd30508', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde57373-b7a2-4e64-b26f-ac6ffca26b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:02 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Volume volume-2f65e5b8-2ff8-4855-9098-4ada6fd30508 (2f65e5b8-2ff8-4855-9098-4ada6fd30508): created successfully Sep 28 17:31:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde57373-b7a2-4e64-b26f-ac6ffca26b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:02 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Flow 'volume_create_manager' (8d8f7d1f-09ce-4c75-a130-ef077eadaa20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:02 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-ba536e19-1cd2-48b8-b700-fd5f87859e95 tempest-ProjectReaderTests-418115774 None] Created volume successfully. Sep 28 17:31:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1e2138fb-cafb-49d2-a3cd-aa038b35c48d tempest-ProjectReaderTests-418115774 None] Acquiring lock "cinder-2f65e5b8-2ff8-4855-9098-4ada6fd30508-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1e2138fb-cafb-49d2-a3cd-aa038b35c48d tempest-ProjectReaderTests-418115774 None] Lock "cinder-2f65e5b8-2ff8-4855-9098-4ada6fd30508-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1e2138fb-cafb-49d2-a3cd-aa038b35c48d tempest-ProjectReaderTests-418115774 None] Acquiring lock "cinder-quobyte-2f65e5b8-2ff8-4855-9098-4ada6fd30508" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:03 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1e2138fb-cafb-49d2-a3cd-aa038b35c48d tempest-ProjectReaderTests-418115774 None] Lock "cinder-quobyte-2f65e5b8-2ff8-4855-9098-4ada6fd30508" acquired by "delete_volume" :: waited 0.020s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:04 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[95771f2d-04ad-4d29-bdd4-65c2b7213826]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1e2138fb-cafb-49d2-a3cd-aa038b35c48d tempest-ProjectReaderTests-418115774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2f65e5b8-2ff8-4855-9098-4ada6fd30508 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:04 devstack sudo[109251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2f65e5b8-2ff8-4855-9098-4ada6fd30508 Sep 28 17:31:04 devstack sudo[109251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:04 devstack sudo[109251]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1e2138fb-cafb-49d2-a3cd-aa038b35c48d tempest-ProjectReaderTests-418115774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2f65e5b8-2ff8-4855-9098-4ada6fd30508" returned: 0 in 0.473s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1e2138fb-cafb-49d2-a3cd-aa038b35c48d tempest-ProjectReaderTests-418115774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2f65e5b8-2ff8-4855-9098-4ada6fd30508 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:04 devstack sudo[109256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2f65e5b8-2ff8-4855-9098-4ada6fd30508 Sep 28 17:31:04 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:04 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1e2138fb-cafb-49d2-a3cd-aa038b35c48d tempest-ProjectReaderTests-418115774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-2f65e5b8-2ff8-4855-9098-4ada6fd30508" returned: 0 in 0.281s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:04 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1e2138fb-cafb-49d2-a3cd-aa038b35c48d tempest-ProjectReaderTests-418115774 None] Lock "cinder-quobyte-2f65e5b8-2ff8-4855-9098-4ada6fd30508" released by "delete_volume" :: held 0.811s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:04 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-1e2138fb-cafb-49d2-a3cd-aa038b35c48d tempest-ProjectReaderTests-418115774 None] Created reservations ['2bcc9592-9656-4e8e-8c50-c093a5506d21', '68edf516-f5fd-47b8-82a1-48e63562bd1b', '8be5a64c-ff18-4756-9af5-ab1858bf7685', '262c5570-a373-4bac-b8a2-53e67c29e8a8'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1e2138fb-cafb-49d2-a3cd-aa038b35c48d tempest-ProjectReaderTests-418115774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1e2138fb-cafb-49d2-a3cd-aa038b35c48d tempest-ProjectReaderTests-418115774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1e2138fb-cafb-49d2-a3cd-aa038b35c48d tempest-ProjectReaderTests-418115774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:04 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1e2138fb-cafb-49d2-a3cd-aa038b35c48d tempest-ProjectReaderTests-418115774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1e2138fb-cafb-49d2-a3cd-aa038b35c48d tempest-ProjectReaderTests-418115774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:04 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1e2138fb-cafb-49d2-a3cd-aa038b35c48d tempest-ProjectReaderTests-418115774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:04 devstack sudo[109260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:31:04 devstack sudo[109260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:05 devstack sudo[109260]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1e2138fb-cafb-49d2-a3cd-aa038b35c48d tempest-ProjectReaderTests-418115774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.280s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1e2138fb-cafb-49d2-a3cd-aa038b35c48d tempest-ProjectReaderTests-418115774 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:05 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-1e2138fb-cafb-49d2-a3cd-aa038b35c48d tempest-ProjectReaderTests-418115774 None] Deleted volume successfully. Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-1e2138fb-cafb-49d2-a3cd-aa038b35c48d tempest-ProjectReaderTests-418115774 None] Lock "cinder-2f65e5b8-2ff8-4855-9098-4ada6fd30508-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Flow 'volume_create_manager' (e82b5132-e64d-4b31-b483-7c6376d6cde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2799af4e-81bb-4dbd-a79d-097a3c20f4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2799af4e-81bb-4dbd-a79d-097a3c20f4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148625482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78e1e4c-8e1f-4068-9327-d275109919fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05582c0d63a94f5488e18e4223ceadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:06Z,use_quota=True,user_id='09a50f9fe1f2451b88f61a97c176bb6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69686c42-7284-4e65-b834-dd53f3bd3d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69686c42-7284-4e65-b834-dd53f3bd3d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af8afcd-25fb-40c1-9c12-6cd083153580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af8afcd-25fb-40c1-9c12-6cd083153580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd78e1e4c-8e1f-4068-9327-d275109919fd', 'volume_name': 'volume-d78e1e4c-8e1f-4068-9327-d275109919fd', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4f7d6cd-3a64-4038-a831-ce5b0818680a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4f7d6cd-3a64-4038-a831-ce5b0818680a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8661531c-e0b8-4d71-bc11-c793cea940a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:05 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Volume d78e1e4c-8e1f-4068-9327-d275109919fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d78e1e4c-8e1f-4068-9327-d275109919fd', 'volume_size': 1} Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148625482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78e1e4c-8e1f-4068-9327-d275109919fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05582c0d63a94f5488e18e4223ceadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:06Z,use_quota=True,user_id='09a50f9fe1f2451b88f61a97c176bb6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Creating volume d78e1e4c-8e1f-4068-9327-d275109919fd {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:05 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:31:05 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d78e1e4c-8e1f-4068-9327-d275109919fd 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:05 devstack sudo[109263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d78e1e4c-8e1f-4068-9327-d275109919fd 1073741824 Sep 28 17:31:05 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:06 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d78e1e4c-8e1f-4068-9327-d275109919fd 1073741824" returned: 0 in 0.615s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d78e1e4c-8e1f-4068-9327-d275109919fd {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:06 devstack sudo[109269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d78e1e4c-8e1f-4068-9327-d275109919fd Sep 28 17:31:06 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:06 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d78e1e4c-8e1f-4068-9327-d275109919fd" returned: 0 in 0.348s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8661531c-e0b8-4d71-bc11-c793cea940a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d78e1e4c-8e1f-4068-9327-d275109919fd', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2807445-a926-4da0-a3e8-eab824ab673c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:31:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:06 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Volume volume-d78e1e4c-8e1f-4068-9327-d275109919fd (d78e1e4c-8e1f-4068-9327-d275109919fd): created successfully Sep 28 17:31:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2807445-a926-4da0-a3e8-eab824ab673c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:06 devstack sudo[109272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:31:06 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:06 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Flow 'volume_create_manager' (e82b5132-e64d-4b31-b483-7c6376d6cde0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:06 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d5c470e7-9ff5-4517-956b-a712923ae96d tempest-ProjectReaderTests-418115774 None] Created volume successfully. Sep 28 17:31:07 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.313s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:31:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:31:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:31:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eda2a2ec-7cd5-4304-ab51-85ecd3a5b34a tempest-ProjectReaderTests-418115774 None] Acquiring lock "cinder-d78e1e4c-8e1f-4068-9327-d275109919fd-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eda2a2ec-7cd5-4304-ab51-85ecd3a5b34a tempest-ProjectReaderTests-418115774 None] Lock "cinder-d78e1e4c-8e1f-4068-9327-d275109919fd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eda2a2ec-7cd5-4304-ab51-85ecd3a5b34a tempest-ProjectReaderTests-418115774 None] Acquiring lock "cinder-quobyte-d78e1e4c-8e1f-4068-9327-d275109919fd" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:07 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eda2a2ec-7cd5-4304-ab51-85ecd3a5b34a tempest-ProjectReaderTests-418115774 None] Lock "cinder-quobyte-d78e1e4c-8e1f-4068-9327-d275109919fd" acquired by "delete_volume" :: waited 0.018s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:07 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07f6553-2957-4a66-a65b-e66b2a9fe7ed]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-eda2a2ec-7cd5-4304-ab51-85ecd3a5b34a tempest-ProjectReaderTests-418115774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d78e1e4c-8e1f-4068-9327-d275109919fd {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:08 devstack sudo[109275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d78e1e4c-8e1f-4068-9327-d275109919fd Sep 28 17:31:08 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:08 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-eda2a2ec-7cd5-4304-ab51-85ecd3a5b34a tempest-ProjectReaderTests-418115774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d78e1e4c-8e1f-4068-9327-d275109919fd" returned: 0 in 0.492s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-eda2a2ec-7cd5-4304-ab51-85ecd3a5b34a tempest-ProjectReaderTests-418115774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d78e1e4c-8e1f-4068-9327-d275109919fd {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:08 devstack sudo[109280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d78e1e4c-8e1f-4068-9327-d275109919fd Sep 28 17:31:08 devstack sudo[109280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:08 devstack sudo[109280]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:08 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-eda2a2ec-7cd5-4304-ab51-85ecd3a5b34a tempest-ProjectReaderTests-418115774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-d78e1e4c-8e1f-4068-9327-d275109919fd" returned: 0 in 0.386s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:08 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eda2a2ec-7cd5-4304-ab51-85ecd3a5b34a tempest-ProjectReaderTests-418115774 None] Lock "cinder-quobyte-d78e1e4c-8e1f-4068-9327-d275109919fd" released by "delete_volume" :: held 0.973s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:08 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-eda2a2ec-7cd5-4304-ab51-85ecd3a5b34a tempest-ProjectReaderTests-418115774 None] Created reservations ['406c9aee-8f71-4da9-b32a-9d71c210a72e', '13c74fdf-8400-4282-a908-f458d681c5fd', 'd3649ad2-9bcb-477d-8c1f-7baf94ac2ece', 'ff856940-cf18-4ad0-bfb5-c47b142fe063'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-eda2a2ec-7cd5-4304-ab51-85ecd3a5b34a tempest-ProjectReaderTests-418115774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-eda2a2ec-7cd5-4304-ab51-85ecd3a5b34a tempest-ProjectReaderTests-418115774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-eda2a2ec-7cd5-4304-ab51-85ecd3a5b34a tempest-ProjectReaderTests-418115774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:09 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-eda2a2ec-7cd5-4304-ab51-85ecd3a5b34a tempest-ProjectReaderTests-418115774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-eda2a2ec-7cd5-4304-ab51-85ecd3a5b34a tempest-ProjectReaderTests-418115774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-eda2a2ec-7cd5-4304-ab51-85ecd3a5b34a tempest-ProjectReaderTests-418115774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:09 devstack sudo[109283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:31:09 devstack sudo[109283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:09 devstack sudo[109283]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:09 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-eda2a2ec-7cd5-4304-ab51-85ecd3a5b34a tempest-ProjectReaderTests-418115774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.322s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:09 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-eda2a2ec-7cd5-4304-ab51-85ecd3a5b34a tempest-ProjectReaderTests-418115774 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:09 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-eda2a2ec-7cd5-4304-ab51-85ecd3a5b34a tempest-ProjectReaderTests-418115774 None] Deleted volume successfully. Sep 28 17:31:09 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-eda2a2ec-7cd5-4304-ab51-85ecd3a5b34a tempest-ProjectReaderTests-418115774 None] Lock "cinder-d78e1e4c-8e1f-4068-9327-d275109919fd-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Flow 'volume_create_manager' (13a67a34-d7d5-4c95-bf60-4167ab2e5cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878507cb-553e-4550-8024-929420027266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878507cb-553e-4550-8024-929420027266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-986477054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ccd627-126e-4f3a-8e4f-394b90eabe77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05582c0d63a94f5488e18e4223ceadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:17Z,use_quota=True,user_id='09a50f9fe1f2451b88f61a97c176bb6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3413a8e4-303c-439d-832d-fee454577ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3413a8e4-303c-439d-832d-fee454577ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da0b149-1f23-4c18-8736-3532881a2a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da0b149-1f23-4c18-8736-3532881a2a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11ccd627-126e-4f3a-8e4f-394b90eabe77', 'volume_name': 'volume-11ccd627-126e-4f3a-8e4f-394b90eabe77', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83609594-3164-48c7-8b3c-ac401743e591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83609594-3164-48c7-8b3c-ac401743e591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e69d17d-093f-4845-92b3-b55ccebcffa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:17 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Volume 11ccd627-126e-4f3a-8e4f-394b90eabe77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11ccd627-126e-4f3a-8e4f-394b90eabe77', 'volume_size': 1} Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-986477054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ccd627-126e-4f3a-8e4f-394b90eabe77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05582c0d63a94f5488e18e4223ceadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:17Z,use_quota=True,user_id='09a50f9fe1f2451b88f61a97c176bb6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Creating volume 11ccd627-126e-4f3a-8e4f-394b90eabe77 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:17 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-11ccd627-126e-4f3a-8e4f-394b90eabe77 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:17 devstack sudo[109333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-11ccd627-126e-4f3a-8e4f-394b90eabe77 1073741824 Sep 28 17:31:17 devstack sudo[109333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:17 devstack sudo[109333]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-11ccd627-126e-4f3a-8e4f-394b90eabe77 1073741824" returned: 0 in 0.481s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:17 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-11ccd627-126e-4f3a-8e4f-394b90eabe77 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:17 devstack sudo[109339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-11ccd627-126e-4f3a-8e4f-394b90eabe77 Sep 28 17:31:17 devstack sudo[109339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:18 devstack sudo[109339]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-11ccd627-126e-4f3a-8e4f-394b90eabe77" returned: 0 in 0.306s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:18 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:18 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e69d17d-093f-4845-92b3-b55ccebcffa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11ccd627-126e-4f3a-8e4f-394b90eabe77', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1101b22-b0ac-4817-9d0b-6079a091db7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:18 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Volume volume-11ccd627-126e-4f3a-8e4f-394b90eabe77 (11ccd627-126e-4f3a-8e4f-394b90eabe77): created successfully Sep 28 17:31:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1101b22-b0ac-4817-9d0b-6079a091db7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:18 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Flow 'volume_create_manager' (13a67a34-d7d5-4c95-bf60-4167ab2e5cf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:18 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-3ed1e679-286c-432d-b4a4-a6c840e12248 tempest-ProjectReaderTests-418115774 None] Created volume successfully. Sep 28 17:31:19 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d7752cff-4c91-4142-ab94-d0a1f66e2983 tempest-ProjectReaderTests-418115774 None] Acquiring lock "cinder-11ccd627-126e-4f3a-8e4f-394b90eabe77-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:19 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d7752cff-4c91-4142-ab94-d0a1f66e2983 tempest-ProjectReaderTests-418115774 None] Lock "cinder-11ccd627-126e-4f3a-8e4f-394b90eabe77-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:19 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d7752cff-4c91-4142-ab94-d0a1f66e2983 tempest-ProjectReaderTests-418115774 None] Acquiring lock "cinder-quobyte-11ccd627-126e-4f3a-8e4f-394b90eabe77" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:19 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d7752cff-4c91-4142-ab94-d0a1f66e2983 tempest-ProjectReaderTests-418115774 None] Lock "cinder-quobyte-11ccd627-126e-4f3a-8e4f-394b90eabe77" acquired by "delete_volume" :: waited 0.015s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:19 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[720e705c-ad2c-4ae8-a4c1-6ba0eeabb473]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d7752cff-4c91-4142-ab94-d0a1f66e2983 tempest-ProjectReaderTests-418115774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-11ccd627-126e-4f3a-8e4f-394b90eabe77 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:19 devstack sudo[109342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-11ccd627-126e-4f3a-8e4f-394b90eabe77 Sep 28 17:31:19 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:19 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d7752cff-4c91-4142-ab94-d0a1f66e2983 tempest-ProjectReaderTests-418115774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-11ccd627-126e-4f3a-8e4f-394b90eabe77" returned: 0 in 0.368s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:19 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d7752cff-4c91-4142-ab94-d0a1f66e2983 tempest-ProjectReaderTests-418115774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-11ccd627-126e-4f3a-8e4f-394b90eabe77 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:19 devstack sudo[109348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-11ccd627-126e-4f3a-8e4f-394b90eabe77 Sep 28 17:31:19 devstack sudo[109348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:20 devstack sudo[109348]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d7752cff-4c91-4142-ab94-d0a1f66e2983 tempest-ProjectReaderTests-418115774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-11ccd627-126e-4f3a-8e4f-394b90eabe77" returned: 0 in 0.263s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:20 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d7752cff-4c91-4142-ab94-d0a1f66e2983 tempest-ProjectReaderTests-418115774 None] Lock "cinder-quobyte-11ccd627-126e-4f3a-8e4f-394b90eabe77" released by "delete_volume" :: held 0.690s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:20 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-d7752cff-4c91-4142-ab94-d0a1f66e2983 tempest-ProjectReaderTests-418115774 None] Created reservations ['488191cd-91bb-40a6-bfab-0cd82f6a1585', '7b95e552-fd8b-4661-9652-703f6a83d85b', 'e52efa22-af98-4788-b448-e65896f3a531', 'd7602e2f-9feb-4476-b1e9-6e35c72e3d52'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d7752cff-4c91-4142-ab94-d0a1f66e2983 tempest-ProjectReaderTests-418115774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d7752cff-4c91-4142-ab94-d0a1f66e2983 tempest-ProjectReaderTests-418115774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:20 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d7752cff-4c91-4142-ab94-d0a1f66e2983 tempest-ProjectReaderTests-418115774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:20 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-d7752cff-4c91-4142-ab94-d0a1f66e2983 tempest-ProjectReaderTests-418115774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-d7752cff-4c91-4142-ab94-d0a1f66e2983 tempest-ProjectReaderTests-418115774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d7752cff-4c91-4142-ab94-d0a1f66e2983 tempest-ProjectReaderTests-418115774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:20 devstack sudo[109351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:31:20 devstack sudo[109351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:20 devstack sudo[109351]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:20 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-d7752cff-4c91-4142-ab94-d0a1f66e2983 tempest-ProjectReaderTests-418115774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.268s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:20 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-d7752cff-4c91-4142-ab94-d0a1f66e2983 tempest-ProjectReaderTests-418115774 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:20 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-d7752cff-4c91-4142-ab94-d0a1f66e2983 tempest-ProjectReaderTests-418115774 None] Deleted volume successfully. Sep 28 17:31:20 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-d7752cff-4c91-4142-ab94-d0a1f66e2983 tempest-ProjectReaderTests-418115774 None] Lock "cinder-11ccd627-126e-4f3a-8e4f-394b90eabe77-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Flow 'volume_create_manager' (7b730fb5-d8c6-4580-a06e-2e108558da56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40deeafd-fdab-4d6f-9d2a-67a57c463110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40deeafd-fdab-4d6f-9d2a-67a57c463110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-740445905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af57143c-4d2a-427b-94cd-9fbfc4eafb79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22e084ad2a24354a9b38b4cef571e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:29Z,use_quota=True,user_id='624135553fc74927be545a0751ad7a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af86b63-7469-4fcd-8c5d-c848b6ebf2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af86b63-7469-4fcd-8c5d-c848b6ebf2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5fd6a9-c200-4dc4-9ee0-c1c9b3a83d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5fd6a9-c200-4dc4-9ee0-c1c9b3a83d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af57143c-4d2a-427b-94cd-9fbfc4eafb79', 'volume_name': 'volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88e4a71-38f3-4f08-b50b-ae2406ccaa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88e4a71-38f3-4f08-b50b-ae2406ccaa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c913db1e-6e64-4e43-88e1-b995852cc40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:29 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Volume af57143c-4d2a-427b-94cd-9fbfc4eafb79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79', 'volume_size': 1} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-740445905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af57143c-4d2a-427b-94cd-9fbfc4eafb79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22e084ad2a24354a9b38b4cef571e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:29Z,use_quota=True,user_id='624135553fc74927be545a0751ad7a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)}" {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Creating volume af57143c-4d2a-427b-94cd-9fbfc4eafb79 {{(pid=87061) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:29 devstack cinder-volume[87061]: INFO cinder.volume.drivers.remotefs [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] casted to osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 1073741824 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:29 devstack sudo[109355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 1073741824 Sep 28 17:31:29 devstack sudo[109355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:29 devstack sudo[109355]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 1073741824" returned: 0 in 0.395s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:29 devstack sudo[109360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 Sep 28 17:31:29 devstack sudo[109360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:29 devstack sudo[109360]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79" returned: 0 in 0.240s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'} {{(pid=87061) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c913db1e-6e64-4e43-88e1-b995852cc40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79', 'volume_size': 1}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e85563f8-b328-4605-90a6-d851619de254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:29 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Volume volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 (af57143c-4d2a-427b-94cd-9fbfc4eafb79): created successfully Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e85563f8-b328-4605-90a6-d851619de254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:29 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Flow 'volume_create_manager' (7b730fb5-d8c6-4580-a06e-2e108558da56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:29 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-08ed8d06-1d8c-4b27-9294-4af6f497e6b7 tempest-SnapshotDependencyTests-674906248 None] Created volume successfully. Sep 28 17:31:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e04501b2-7be9-4255-bfaa-f3eda000e422 tempest-SnapshotDependencyTests-674906248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e04501b2-7be9-4255-bfaa-f3eda000e422 tempest-SnapshotDependencyTests-674906248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:30 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-e04501b2-7be9-4255-bfaa-f3eda000e422 tempest-SnapshotDependencyTests-674906248 None] Creating offline snapshot c0218829-58ea-4806-81c8-e21bf39785ba of volume af57143c-4d2a-427b-94cd-9fbfc4eafb79 {{(pid=87061) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:31:30 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10a8eed-c86b-462e-9520-b84582f61ca0]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e04501b2-7be9-4255-bfaa-f3eda000e422 tempest-SnapshotDependencyTests-674906248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:30 devstack sudo[109363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 Sep 28 17:31:30 devstack sudo[109363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:30 devstack sudo[109363]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e04501b2-7be9-4255-bfaa-f3eda000e422 tempest-SnapshotDependencyTests-674906248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79" returned: 0 in 0.368s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:30 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e04501b2-7be9-4255-bfaa-f3eda000e422 tempest-SnapshotDependencyTests-674906248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba 1G {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:30 devstack sudo[109368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba 1G Sep 28 17:31:30 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:31 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e04501b2-7be9-4255-bfaa-f3eda000e422 tempest-SnapshotDependencyTests-674906248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba 1G" returned: 0 in 0.411s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e04501b2-7be9-4255-bfaa-f3eda000e422 tempest-SnapshotDependencyTests-674906248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:31 devstack sudo[109373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba Sep 28 17:31:31 devstack sudo[109373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:31 devstack sudo[109373]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e04501b2-7be9-4255-bfaa-f3eda000e422 tempest-SnapshotDependencyTests-674906248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 -F qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba" returned: 0 in 0.300s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:31 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-e04501b2-7be9-4255-bfaa-f3eda000e422 tempest-SnapshotDependencyTests-674906248 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba is being set with open permissions: ugo+rw Sep 28 17:31:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e04501b2-7be9-4255-bfaa-f3eda000e422 tempest-SnapshotDependencyTests-674906248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:31 devstack sudo[109378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba Sep 28 17:31:31 devstack sudo[109378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:31 devstack sudo[109378]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e04501b2-7be9-4255-bfaa-f3eda000e422 tempest-SnapshotDependencyTests-674906248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba" returned: 0 in 0.237s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e04501b2-7be9-4255-bfaa-f3eda000e422 tempest-SnapshotDependencyTests-674906248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:31 devstack sudo[109381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.info Sep 28 17:31:31 devstack sudo[109381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:31 devstack sudo[109381]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e04501b2-7be9-4255-bfaa-f3eda000e422 tempest-SnapshotDependencyTests-674906248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.info" returned: 0 in 0.247s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:31 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-e04501b2-7be9-4255-bfaa-f3eda000e422 tempest-SnapshotDependencyTests-674906248 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.info is being set with open permissions: ugo+rw Sep 28 17:31:31 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e04501b2-7be9-4255-bfaa-f3eda000e422 tempest-SnapshotDependencyTests-674906248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.info {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:31 devstack sudo[109384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.info Sep 28 17:31:31 devstack sudo[109384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:32 devstack sudo[109384]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-e04501b2-7be9-4255-bfaa-f3eda000e422 tempest-SnapshotDependencyTests-674906248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.info" returned: 0 in 0.254s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:32 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-e04501b2-7be9-4255-bfaa-f3eda000e422 tempest-SnapshotDependencyTests-674906248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.910s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:32 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-e04501b2-7be9-4255-bfaa-f3eda000e422 tempest-SnapshotDependencyTests-674906248 None] Create snapshot completed successfully Sep 28 17:31:32 devstack cinder-volume[87061]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87061) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Flow 'volume_create_manager' (a4af52ae-0445-4b99-9bae-7d644d53973f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:32 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1194b29-c97e-4a33-8b95-33f5bae80377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1194b29-c97e-4a33-8b95-33f5bae80377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=614faae9-5516-47a8-b7f3-0d8e09db5c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22e084ad2a24354a9b38b4cef571e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c0218829-58ea-4806-81c8-e21bf39785ba,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:33Z,use_quota=True,user_id='624135553fc74927be545a0751ad7a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3aa0fe-1681-4f9e-abfb-5be91baf66ad),volume_type_id=2c3aa0fe-1681-4f9e-abfb-5be91baf66ad)' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b7c7d2-966f-47c8-a441-256ab22b22bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b7c7d2-966f-47c8-a441-256ab22b22bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b90561-4247-4f5d-853e-813ecb7cf10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b90561-4247-4f5d-853e-813ecb7cf10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '614faae9-5516-47a8-b7f3-0d8e09db5c65', 'volume_name': 'volume-614faae9-5516-47a8-b7f3-0d8e09db5c65', 'volume_size': 1, 'snapshot_id': 'c0218829-58ea-4806-81c8-e21bf39785ba'}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf5ede4-f4b2-43e4-915f-041f0c49370a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf5ede4-f4b2-43e4-915f-041f0c49370a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d86b7f7b-d37e-4af2-b2d2-b924167aa51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:33 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Volume 614faae9-5516-47a8-b7f3-0d8e09db5c65: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-614faae9-5516-47a8-b7f3-0d8e09db5c65', 'volume_size': 1, 'snapshot_id': 'c0218829-58ea-4806-81c8-e21bf39785ba'} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Acquiring lock "cinder-quobyte-c0218829-58ea-4806-81c8-e21bf39785ba-614faae9-5516-47a8-b7f3-0d8e09db5c65" by "_create_volume_from_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Lock "cinder-quobyte-c0218829-58ea-4806-81c8-e21bf39785ba-614faae9-5516-47a8-b7f3-0d8e09db5c65" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Creating volume 614faae9-5516-47a8-b7f3-0d8e09db5c65 from snapshot c0218829-58ea-4806-81c8-e21bf39785ba {{(pid=87061) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Selected osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d as target Quobyte volume. {{(pid=87061) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Acquiring lock "cinder-quobyte-614faae9-5516-47a8-b7f3-0d8e09db5c65" by "_copy_volume_from_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Lock "cinder-quobyte-614faae9-5516-47a8-b7f3-0d8e09db5c65" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] snapshot: c0218829-58ea-4806-81c8-e21bf39785ba, volume: 614faae9-5516-47a8-b7f3-0d8e09db5c65, {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[706d6794-2393-4f78-b12b-8e36a5c4142e]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:33 devstack sudo[109387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba Sep 28 17:31:33 devstack sudo[109387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:33 devstack sudo[109387]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba" returned: 0 in 0.351s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[41517ded-e87e-4ed6-8cde-84b78e150a91]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:33 devstack sudo[109393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 Sep 28 17:31:33 devstack sudo[109393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:33 devstack sudo[109393]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79" returned: 0 in 0.357s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Creating direct copy from snapshot {{(pid=87061) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG cinder.utils [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Path /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-614faae9-5516-47a8-b7f3-0d8e09db5c65 not found in is_blk_device check {{(pid=87061) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:31:33 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-614faae9-5516-47a8-b7f3-0d8e09db5c65 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:33 devstack sudo[109398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-614faae9-5516-47a8-b7f3-0d8e09db5c65 Sep 28 17:31:33 devstack sudo[109398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:39 devstack sudo[109398]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-614faae9-5516-47a8-b7f3-0d8e09db5c65" returned: 0 in 5.620s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:39 devstack cinder-volume[87061]: DEBUG cinder.image.image_utils [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Image conversion details: src /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79, size 1024.00 MB, duration 5.62 sec, destination /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-614faae9-5516-47a8-b7f3-0d8e09db5c65 {{(pid=87061) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:31:39 devstack cinder-volume[87061]: INFO cinder.image.image_utils [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Converted 1024.00 MB image at 182.16 MB/s Sep 28 17:31:39 devstack cinder-volume[87061]: WARNING cinder.volume.drivers.remotefs [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-614faae9-5516-47a8-b7f3-0d8e09db5c65 is being set with open permissions: ugo+rw Sep 28 17:31:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-614faae9-5516-47a8-b7f3-0d8e09db5c65 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:39 devstack sudo[109412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-614faae9-5516-47a8-b7f3-0d8e09db5c65 Sep 28 17:31:39 devstack sudo[109412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:39 devstack sudo[109412]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-614faae9-5516-47a8-b7f3-0d8e09db5c65" returned: 0 in 0.233s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Lock "cinder-quobyte-614faae9-5516-47a8-b7f3-0d8e09db5c65" released by "_copy_volume_from_snapshot" :: held 6.645s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:39 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Lock "cinder-quobyte-c0218829-58ea-4806-81c8-e21bf39785ba-614faae9-5516-47a8-b7f3-0d8e09db5c65" released by "_create_volume_from_snapshot" :: held 6.700s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:39 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.717s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:39 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d86b7f7b-d37e-4af2-b2d2-b924167aa51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-614faae9-5516-47a8-b7f3-0d8e09db5c65', 'volume_size': 1, 'snapshot_id': 'c0218829-58ea-4806-81c8-e21bf39785ba'}' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:39 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ff3e64-2bdf-4c0a-84c2-89d2e03ae6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:39 devstack cinder-volume[87061]: INFO cinder.volume.flows.manager.create_volume [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Volume volume-614faae9-5516-47a8-b7f3-0d8e09db5c65 (614faae9-5516-47a8-b7f3-0d8e09db5c65): created successfully Sep 28 17:31:39 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ff3e64-2bdf-4c0a-84c2-89d2e03ae6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87061) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:39 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Flow 'volume_create_manager' (a4af52ae-0445-4b99-9bae-7d644d53973f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87061) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:39 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-6f1ec056-d641-4bf6-b33c-6f4baa488928 tempest-SnapshotDependencyTests-674906248 None] Created volume successfully. Sep 28 17:31:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-aecc52db-2220-40bd-9c85-574de0676512 tempest-SnapshotDependencyTests-674906248 None] Acquiring lock "cinder-c0218829-58ea-4806-81c8-e21bf39785ba-delete_snapshot" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-aecc52db-2220-40bd-9c85-574de0676512 tempest-SnapshotDependencyTests-674906248 None] Lock "cinder-c0218829-58ea-4806-81c8-e21bf39785ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-aecc52db-2220-40bd-9c85-574de0676512 tempest-SnapshotDependencyTests-674906248 None] Acquiring lock "cinder-quobyte-af57143c-4d2a-427b-94cd-9fbfc4eafb79" by "delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-aecc52db-2220-40bd-9c85-574de0676512 tempest-SnapshotDependencyTests-674906248 None] Lock "cinder-quobyte-af57143c-4d2a-427b-94cd-9fbfc4eafb79" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-aecc52db-2220-40bd-9c85-574de0676512 tempest-SnapshotDependencyTests-674906248 None] Acquiring lock "cinder-quobyte-c0218829-58ea-4806-81c8-e21bf39785ba" by "_delete_snapshot" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:40 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-aecc52db-2220-40bd-9c85-574de0676512 tempest-SnapshotDependencyTests-674906248 None] Lock "cinder-quobyte-c0218829-58ea-4806-81c8-e21bf39785ba" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:40 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-aecc52db-2220-40bd-9c85-574de0676512 tempest-SnapshotDependencyTests-674906248 None] Deleting offline snapshot c0218829-58ea-4806-81c8-e21bf39785ba of volume af57143c-4d2a-427b-94cd-9fbfc4eafb79 {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:31:40 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-aecc52db-2220-40bd-9c85-574de0676512 tempest-SnapshotDependencyTests-674906248 None] snapshot_file for this snap is: volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba {{(pid=87061) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:31:40 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[a165dcdb-48e3-4b07-b8d9-3cfbc344a752]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:40 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aecc52db-2220-40bd-9c85-574de0676512 tempest-SnapshotDependencyTests-674906248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:40 devstack sudo[109415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba Sep 28 17:31:40 devstack sudo[109415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:41 devstack sudo[109415]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aecc52db-2220-40bd-9c85-574de0676512 tempest-SnapshotDependencyTests-674906248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba" returned: 0 in 0.377s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:41 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.remotefs [None req-aecc52db-2220-40bd-9c85-574de0676512 tempest-SnapshotDependencyTests-674906248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87061) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:31:41 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5c36c8-d665-4bc9-8c10-224143e0f0fd]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aecc52db-2220-40bd-9c85-574de0676512 tempest-SnapshotDependencyTests-674906248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:41 devstack sudo[109421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 Sep 28 17:31:41 devstack sudo[109421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:41 devstack sudo[109421]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aecc52db-2220-40bd-9c85-574de0676512 tempest-SnapshotDependencyTests-674906248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79" returned: 0 in 0.525s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aecc52db-2220-40bd-9c85-574de0676512 tempest-SnapshotDependencyTests-674906248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:41 devstack sudo[109426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba Sep 28 17:31:41 devstack sudo[109426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:41 devstack sudo[109426]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aecc52db-2220-40bd-9c85-574de0676512 tempest-SnapshotDependencyTests-674906248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba" returned: 0 in 0.335s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:41 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aecc52db-2220-40bd-9c85-574de0676512 tempest-SnapshotDependencyTests-674906248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:41 devstack sudo[109431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba Sep 28 17:31:41 devstack sudo[109431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:42 devstack sudo[109431]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-aecc52db-2220-40bd-9c85-574de0676512 tempest-SnapshotDependencyTests-674906248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79.c0218829-58ea-4806-81c8-e21bf39785ba" returned: 0 in 0.265s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-aecc52db-2220-40bd-9c85-574de0676512 tempest-SnapshotDependencyTests-674906248 None] Lock "cinder-quobyte-c0218829-58ea-4806-81c8-e21bf39785ba" released by "_delete_snapshot" :: held 1.610s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-aecc52db-2220-40bd-9c85-574de0676512 tempest-SnapshotDependencyTests-674906248 None] Lock "cinder-quobyte-af57143c-4d2a-427b-94cd-9fbfc4eafb79" released by "delete_snapshot" :: held 1.634s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:42 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-aecc52db-2220-40bd-9c85-574de0676512 tempest-SnapshotDependencyTests-674906248 None] Created reservations ['dd59f1ad-95ae-43cf-b2e0-8e555aa3e02a', '41845e32-10b5-4bea-b112-40db4a7af888', '39fc6179-01bb-48fa-b432-be89c4bcc929', '4dd5ef3f-ce9b-4c14-a164-843d6c3ae3c9'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:42 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-aecc52db-2220-40bd-9c85-574de0676512 tempest-SnapshotDependencyTests-674906248 None] Delete snapshot completed successfully. Sep 28 17:31:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-aecc52db-2220-40bd-9c85-574de0676512 tempest-SnapshotDependencyTests-674906248 None] Lock "cinder-c0218829-58ea-4806-81c8-e21bf39785ba-delete_snapshot" released by "delete_snapshot" :: held 1.769s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ea0ebb7e-b790-4df3-a057-29646dbb5cf7 tempest-SnapshotDependencyTests-674906248 None] Acquiring lock "cinder-af57143c-4d2a-427b-94cd-9fbfc4eafb79-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ea0ebb7e-b790-4df3-a057-29646dbb5cf7 tempest-SnapshotDependencyTests-674906248 None] Lock "cinder-af57143c-4d2a-427b-94cd-9fbfc4eafb79-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ea0ebb7e-b790-4df3-a057-29646dbb5cf7 tempest-SnapshotDependencyTests-674906248 None] Acquiring lock "cinder-quobyte-af57143c-4d2a-427b-94cd-9fbfc4eafb79" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:42 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ea0ebb7e-b790-4df3-a057-29646dbb5cf7 tempest-SnapshotDependencyTests-674906248 None] Lock "cinder-quobyte-af57143c-4d2a-427b-94cd-9fbfc4eafb79" acquired by "delete_volume" :: waited 0.015s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:42 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f064510-6e74-4c19-bd97-a1a644fb10a7]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:42 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ea0ebb7e-b790-4df3-a057-29646dbb5cf7 tempest-SnapshotDependencyTests-674906248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:42 devstack sudo[109434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 Sep 28 17:31:42 devstack sudo[109434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:43 devstack sudo[109434]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ea0ebb7e-b790-4df3-a057-29646dbb5cf7 tempest-SnapshotDependencyTests-674906248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79" returned: 0 in 0.381s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ea0ebb7e-b790-4df3-a057-29646dbb5cf7 tempest-SnapshotDependencyTests-674906248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:43 devstack sudo[109439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79 Sep 28 17:31:43 devstack sudo[109439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:43 devstack sudo[109439]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ea0ebb7e-b790-4df3-a057-29646dbb5cf7 tempest-SnapshotDependencyTests-674906248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-af57143c-4d2a-427b-94cd-9fbfc4eafb79" returned: 0 in 0.264s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ea0ebb7e-b790-4df3-a057-29646dbb5cf7 tempest-SnapshotDependencyTests-674906248 None] Lock "cinder-quobyte-af57143c-4d2a-427b-94cd-9fbfc4eafb79" released by "delete_volume" :: held 0.712s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:43 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-ea0ebb7e-b790-4df3-a057-29646dbb5cf7 tempest-SnapshotDependencyTests-674906248 None] Created reservations ['5d40b347-f950-4e85-b509-42a8279a7743', '7a2658de-3371-4028-8c9d-facff5171340', '9a8e41d5-4b22-4ed5-9816-2c8dee8eb8d0', '395b962f-be35-49cd-bcca-d069b776791d'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ea0ebb7e-b790-4df3-a057-29646dbb5cf7 tempest-SnapshotDependencyTests-674906248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ea0ebb7e-b790-4df3-a057-29646dbb5cf7 tempest-SnapshotDependencyTests-674906248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:43 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ea0ebb7e-b790-4df3-a057-29646dbb5cf7 tempest-SnapshotDependencyTests-674906248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:43 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-ea0ebb7e-b790-4df3-a057-29646dbb5cf7 tempest-SnapshotDependencyTests-674906248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-ea0ebb7e-b790-4df3-a057-29646dbb5cf7 tempest-SnapshotDependencyTests-674906248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ea0ebb7e-b790-4df3-a057-29646dbb5cf7 tempest-SnapshotDependencyTests-674906248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:43 devstack sudo[109442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:31:43 devstack sudo[109442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:43 devstack sudo[109442]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-ea0ebb7e-b790-4df3-a057-29646dbb5cf7 tempest-SnapshotDependencyTests-674906248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.244s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:43 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-ea0ebb7e-b790-4df3-a057-29646dbb5cf7 tempest-SnapshotDependencyTests-674906248 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:43 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-ea0ebb7e-b790-4df3-a057-29646dbb5cf7 tempest-SnapshotDependencyTests-674906248 None] Deleted volume successfully. Sep 28 17:31:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-01682f66-fc0b-4637-9912-258da0bb578e tempest-SnapshotDependencyTests-674906248 None] Acquiring lock "cinder-614faae9-5516-47a8-b7f3-0d8e09db5c65-delete_volume" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-ea0ebb7e-b790-4df3-a057-29646dbb5cf7 tempest-SnapshotDependencyTests-674906248 None] Lock "cinder-af57143c-4d2a-427b-94cd-9fbfc4eafb79-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-01682f66-fc0b-4637-9912-258da0bb578e tempest-SnapshotDependencyTests-674906248 None] Lock "cinder-614faae9-5516-47a8-b7f3-0d8e09db5c65-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-01682f66-fc0b-4637-9912-258da0bb578e tempest-SnapshotDependencyTests-674906248 None] Acquiring lock "cinder-quobyte-614faae9-5516-47a8-b7f3-0d8e09db5c65" by "delete_volume" {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:43 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-01682f66-fc0b-4637-9912-258da0bb578e tempest-SnapshotDependencyTests-674906248 None] Lock "cinder-quobyte-614faae9-5516-47a8-b7f3-0d8e09db5c65" acquired by "delete_volume" :: waited 0.014s {{(pid=87061) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:43 devstack cinder-volume[87061]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f0de49-05cd-418e-b536-db7cc0e95a44]: (4, 'qcow2') {{(pid=88635) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:43 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-01682f66-fc0b-4637-9912-258da0bb578e tempest-SnapshotDependencyTests-674906248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-614faae9-5516-47a8-b7f3-0d8e09db5c65 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:44 devstack sudo[109445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-614faae9-5516-47a8-b7f3-0d8e09db5c65 Sep 28 17:31:44 devstack sudo[109445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:44 devstack sudo[109445]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-01682f66-fc0b-4637-9912-258da0bb578e tempest-SnapshotDependencyTests-674906248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-614faae9-5516-47a8-b7f3-0d8e09db5c65" returned: 0 in 0.369s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-01682f66-fc0b-4637-9912-258da0bb578e tempest-SnapshotDependencyTests-674906248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-614faae9-5516-47a8-b7f3-0d8e09db5c65 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:44 devstack sudo[109450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-614faae9-5516-47a8-b7f3-0d8e09db5c65 Sep 28 17:31:44 devstack sudo[109450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:44 devstack sudo[109450]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-01682f66-fc0b-4637-9912-258da0bb578e tempest-SnapshotDependencyTests-674906248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6/volume-614faae9-5516-47a8-b7f3-0d8e09db5c65" returned: 0 in 0.260s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:44 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-01682f66-fc0b-4637-9912-258da0bb578e tempest-SnapshotDependencyTests-674906248 None] Lock "cinder-quobyte-614faae9-5516-47a8-b7f3-0d8e09db5c65" released by "delete_volume" :: held 0.673s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:44 devstack cinder-volume[87061]: DEBUG cinder.quota [None req-01682f66-fc0b-4637-9912-258da0bb578e tempest-SnapshotDependencyTests-674906248 None] Created reservations ['4cdd050a-d438-4411-aee9-890a5b12a4bc', 'ea67f7e4-7f9d-4a4c-bb88-545f363ceb82', '974d0edb-f475-4b71-b5fc-15bfb463cff0', 'ea6bed36-06d5-4358-86ad-cbfac653bfa7'] {{(pid=87061) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-01682f66-fc0b-4637-9912-258da0bb578e tempest-SnapshotDependencyTests-674906248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-01682f66-fc0b-4637-9912-258da0bb578e tempest-SnapshotDependencyTests-674906248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-01682f66-fc0b-4637-9912-258da0bb578e tempest-SnapshotDependencyTests-674906248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:44 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-01682f66-fc0b-4637-9912-258da0bb578e tempest-SnapshotDependencyTests-674906248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-01682f66-fc0b-4637-9912-258da0bb578e tempest-SnapshotDependencyTests-674906248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-01682f66-fc0b-4637-9912-258da0bb578e tempest-SnapshotDependencyTests-674906248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:44 devstack sudo[109454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:31:44 devstack sudo[109454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:44 devstack sudo[109454]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:44 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-01682f66-fc0b-4637-9912-258da0bb578e tempest-SnapshotDependencyTests-674906248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.244s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:44 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-01682f66-fc0b-4637-9912-258da0bb578e tempest-SnapshotDependencyTests-674906248 None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:44 devstack cinder-volume[87061]: INFO cinder.volume.manager [None req-01682f66-fc0b-4637-9912-258da0bb578e tempest-SnapshotDependencyTests-674906248 None] Deleted volume successfully. Sep 28 17:31:45 devstack cinder-volume[87061]: DEBUG cinder.coordination [None req-01682f66-fc0b-4637-9912-258da0bb578e tempest-SnapshotDependencyTests-674906248 None] Lock "cinder-614faae9-5516-47a8-b7f3-0d8e09db5c65-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=87061) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:54 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:SELECT=53,cinder:UPDATE=78,cinder:INSERT=21,cinder:DELETE=4 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:31:55 devstack cinder-volume[87061]: DEBUG dbcounter [-] [87061] Writing DB stats cinder:UPDATE=68,cinder:DELETE=9,cinder:SELECT=52,cinder:INSERT=14 {{(pid=87061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:32:06 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:32:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d': None} {{(pid=87061) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:06 devstack cinder-volume[87061]: DEBUG cinder.volume.drivers.quobyte [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4121c71a-59b2-4174-a0e8-e1a4852eec5d'] {{(pid=87061) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.lockutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87061) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:06 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:06 devstack sudo[109469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6 Sep 28 17:32:06 devstack sudo[109469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:07 devstack sudo[109469]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:07 devstack cinder-volume[87061]: DEBUG oslo_concurrency.processutils [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fb75aa38c47d1c1ad5c70e810f6c25c6" returned: 0 in 0.240s {{(pid=87061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:07 devstack cinder-volume[87061]: DEBUG cinder.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Notifying Schedulers of capabilities ... {{(pid=87061) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:32:07 devstack cinder-volume[87061]: DEBUG oslo_service.periodic_task [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] Running periodic task VolumeManager._thread_info {{(pid=87061) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:32:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread count: 28 {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:32:07 devstack cinder-volume[87061]: DEBUG cinder.volume.manager [None req-1a160b0c-e924-4eeb-a48e-592fdeb29fc4 None None] thread info: [<_MainThread(MainThread, started 129030301552768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87061) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}